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ABSTRACT 



Title of Project: Learning and Retention by Informing 

Students of Behavioral Objectives and 
their Place in the Hierarchical 
Learning Sequence 



This study was conducted to investigate the question: 

If a group of students is informed of the behavioral 
objectives and the learning hierarchy of a unit of 
instruction and another group of students receiving 
the same unit of instruction is not so informed, will 
there be differences in effect on learning and reten- 
tion? 



It was expected that those students who are informed of the 
behavioral objectives of an activity will perform higher on 
achievement and retention posttests than those students who 
are not so informed. Moreover, it was expected that students 
who are informed of the activity's place in a hierarchical 
learning sequence (designed after Robert Gagnd's cumulative 
learning model) in addition to being informed of the 
behavioral objectives of the activity will perform higher 
on achievement and retention posttests than those who are 
informed just of the behavioral objectives of the activity. 
The author's research was designed to determine whether for 



» 

i 



o 



a specific population with specific treatments data could he 
obtained to support the .above expectations. Accordingly, 
eighty-eight elementary education majors in a four-year col- 
lege were! block ed 1 ' on ability levels and randomly assigned to 

• • * i' " 

four treatments. While receiving. 'different information about 



the behaviorai objectives and the hierarchical learning 
sequence, all four groups received the same set of sel f f- 
instructional text material covering a mathematical unit of 
instruction. Nine hypotheses were formulated. 

, 4 9 \ • e 

The subjects were' students enrolled in four sections 



of the second’ semester of a two-semester sequence mathemat- 

- ,7 I VyV ■ \ ' 1 * 5 •• . ' ' ■ ' f 

ics course for elementary .education majors at Towson State 

College, Baltimore, Marvland in the spring of 1969. The 

• v.H •“ * ;? ■ -<r i- —.;r- ; ' y* : 

students were classified according to their ability levels 

•. oerr •-••••'• ••• 

as reflected by their grades in the first semester of the 
two-semester sequence course before being randomly assigned 



to the following four treatments: 




-self -instructional text material on a irathe- 

, * 1 , 

matical unit. 




•se. 



£~ instructional text material on a mathe- 



matical unif. with statements and examples of 
the behavioral objectives given to the student 
before each activity in the unit. 



T — self-instructional text material on a mathe- 
^ matical unit with a copy of the learning 
hierarchy with examples of each cell in the 
hierarchy given to the student at the 
beginning and at the end of the unit* 



— self-instructional text material on a mathe- 
matical unit with the students given: 

(a) copies of the learning hierarchy (with 
cell examples) at the beginning of the 
unit, 

(b) statements and examples of the behavioral 
objectives of each activity at the begin- 
ning of each activity and a description 

of that activity's place in the hierarchi- 
cal learning sequence. 

The self -instructional material for the instructional 
unit was developed for this study and was based upon t'he 
learning hierarchy constructed for the experiment. The treat- 
ment material, consisting of ten activity booklets, was 
administered by the experimentor for eight consecutive class 
days. After the completion of the instructional unit, post- 
tests were administered immediately to compare the degree of 
learning, and, after two weeks, to compare the amount of 
retention. 

Through treatraents-by- levels ana3.ys.is of variance, 
the relative ef fectiveness of the four treatments on student 
achievement as measured by the immediate posttest was deter- 
mined. Differential effects of the four treatments on learn- 
ing the intellectual skill of the terminal task of the 

/ 

learning hierarchy were not significant at the 0.05 level. 

The treatments -by- levels interaction effects of the four 
treatments were also found not significant at the 0.05 level. 

At a 0.05 level of significance, a repeated measures 



analysis detected no differential effects, resulting from 
the four treatments, on student over-all performance. How- 
ever, the four treatments resulted in signi.i icantly different 
rates of forgetting. The group of students who were given 
statements of each activity's objective showed a positive 
gain in performance over time. In addition, the differences 
in the over-all performance scores resulting from the four 
treatments were not identically reflected at each ability 
level. 

The results of the study do not substantiate the 
thesis that informing students of the behavioral objectives 
and/or learning hierarchy can enhance their performance on 
an immediate achievement test. However, the study does sug- 
gest that giving students statements and examples of the 
behavioral objectives is an instructional method that will 
result in resistance to forgetting. 
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CHAPTER I 
INTRODUCTION 

In 1955 Mayor, Henkleman, and Walbesser (1) stated 
in reference to the new mathematics and science programs in 
secondary schools that, while the decade 1955-65 had been 
one of curriculum innovation, the next should become one of 
research in learning and teaching of mathematics and science . 
The need and interest in classroom research for the benefit 
of curriculum reform has bean expressed in other areas 
besides the area of teaching mathematics and science. 



is increased learning and retention. There have been many 
research studies conducted to determine the effects of various 



these studies have contrasted the effect on achievement and 
retention of different classroom materials and different 
methods of instructing the student in the classroom. Although 
such efforts have been ext&nsive, in a recent journal article 
entitled "On the Assessment of Retention Effects in Educa- 



A principal goal of the curriculum-reform movement 



. manipulative variables on learning and retention. Many of 



tional Experiments" Kenneth H. (2) of The Pennsylvania 

X 

State University made a plea /for an even greater emphasis on 
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long -terra follow-up measures in studies of the effects of 
instructional treatments. He argued that there is a need 
for the investigation of instructional treatments specifically 
designed to facilitate such long-term effects. He pointed 
out that, even though some instructional • variations might he 
of little value in facilitating the amount of learning, these 
same variations might have their primary effects on lonjg-terrn 
retention. That is, an instructional treatment might produce 
relatively inefficient learning, but gxeater resistance to 
forgetting than some other treatments. 

Advocates of behavioral objectives for education, 
such as Gagn<£ (3), Mager (4), and Walbessor (5) have called 
for more specific statements of purpose and expected outcomes 
m new curriculum development. The American Association for 
the Advancement of Science has developed a curriculum entitled 
S c ienc e — A. Process Approach (6), in which the objectives of 
the curriculum are stated in terms of what the student is to 
• do rather than in terms of verbalizable knowledge that the 
student is to know. Behavioral descriptions of the objec- 
tives of curriculum has become basic to some new proposals 
for curriculum revision and development. Another dimension 
of curriculum design which has begun to play an import ant 
role in new curriculum developments is the construction 
of learning hierarchies. Gagne has hypothesized that 







asanas 



intellectual skills that are learned 



» • * have an ordered relation to each other, such 
that subordinate ones contribute positive transfer 
to super ordinate ones [7] . 

Gagnd refers to learning sequences which exhibit such ordered 
relations between the behavioral objectives as learning hier- 
archies. '.There have been several recent researches reported 
which investigated the problems of hierarchy construction 
and behavioral description of learning outcomes. Among the 
recent contributions to this literature are those by Gagnd 
(8, 9), Walbesser (10, 11, 12), Walbesser and Carter (13), 
and Engel (14) . 

It is in the context of these three points (1) need 
for long-term studies, (2) need for behavioral objectives, 
and (3) need for learning hierarchies, that led to the 
posing of the following question: If a group of students 

is informed of the behavioral objectives and the learning 
hierarchy of a unit of instruction and another group of 
students receiving the same unit of instruction is not so 

t 

informed, will there be differences in effect on learning 
and retention? 

A review of the literature in Chapter II seeks to 
establish the rationale for the question. Chapter II also 
includes statements of the research hypotheses tested in 
this study which are associated with the question. 



4 



Chapter III describes the procedure followed in the 
research. The findings of the investigation are presented 
in Chapter XV. Chapter V presents the conclusions of the 
study based upon the findings. 



5 



FOOTNOTES — CHAPTER I 

* 



X 

J. R. Mayor, J. H . Henkleman, and H. H. Walbesser, 
M An Implication for Teacher Education of Recent Research in 
Mathematics Education,” Journal of Teacher Education , XVI, 

No. 4 (December, 1965), 485-90. 

2 

Kenneth H. Wodtke, “On the Assessment of Retention 
Effects in Educational Experiments, " The J o urnal of Expert- 
mental Education . XXXV, No. 4 (Summer, 1967), 28-36. 

3 

Robert M* Gagne, The Cond i tions of Learn ing (New 
York: Holt, Rinehart, and Winston, Inc., 1965). 

4 

Robert F. Mager, Preparing Instructional Objectives 
(Palo Alto: Fearon, 1962). 

5 

Henry H. Walbesser, Constructing Behavioral Objec- 
tives (College Park: The Bureau of Educational Research and 

Field Services, University of Maryland, 1968) . 

^Robert M. Gagnd, Science — A Process Approach: Pur- 

poses, Accomplishments, Expectations (Miscellaneous Publica- 
tions, 67-12, Washington, D.C. : American Association for the 

Advancement of Science, 1967) . 



Robert M. Gagne, "Learning Hierarchies" (Presidential 
Address, Division 15, American Psychological Association), 
August, 1968. 

s 

Robert M. Gagne, John R. Mayor, Helen L. Garstens, 
and Noel E. Paradise, "Factors in Acquiring Knowledge of a 
Mathematical Task, " Psychological Monographs . LXXV, No. 14 
(Whole No. 526), 1962. ~~ 

9 

Robert M. Gagnd and Noel E. Paradise, "Abilities and 
Learning Sets in Knowledge Acquisition, " Psychological Mono- 
graphs , LXXV, No. 14 (Whole No. 518), 1961. ~~ 

10 

Henry H. Walbesser, "Curriculum Evaluation by Means 
of Behavioral Objectives, " Journal of Research in Science 
Teachin g, I (1963), 296-301. ~ ~~~ 

11 

Henry H* Walbesser, "Science Curriculum Evaluation: 
Observations on a Position," The Science Teacher , XXXII, 

No. 2 (1966), 34-39. 



o 



6 



.12 

Henry H. Walbesser, An Eval uati on Model and Its 
* Report , Miscel laneou s Pub licatio n No , 

Mri (Washington, D.C.: American Association for the 

Advancement of Science, 1968). 

13 

Henry H • Walbesser and Heather L. Carter, "Acqui- 
sition of Elementary Science Behavior by Children of Dis- 
advantaged Families, " Educatio nal L ea der shi p, XXV, No. 8 
(May, 1968), 741-48, ~ ~ ’ T 



14 

Roberta S . Engel, "An Experimental Study of the 
Effects of Stated Behavioral Objectives on Achievement in 
a Unit of Instruction on Negative and Rational B,.se Systems 
of Numerations" (unpublished Master's thesis. The University 
of Maryland, College Park, 1968), 



o 

ERIC 



CHAPTER II 



REVIEW OF LITERATURE MD 
RELATED RESEARCH 



The first section of this chapter discusses th<^ 
application of behavioral objectives to curriculum design. 
The utilization of learning hierarchies in designing cur- 
riculum is discussed in the second section. The last 
section is concerned with the importance of behavioral 
objectives and learning hierarchies from the point of view 
of student acquisition. 

BEHAVIORAL OBJECTIVES MD 
CURRICULUM DESIGN 

The expression “behavioral objectives’* is in vogue 

in current educational circles. In a description of how 

fashionable the topic of behavioral objectives is today in 

the field of education, Walbesser stated in his text, 

constructing Behavioral Objec tive s; 

Few professional meetings of educators escape from 
talk about objectives. Individuals involved with 
the public and private funding agencies speak of 
the need for more specific statements of purpose 
and expected outcomes. Aspiring developers of 



8 



instructional systems identify behavioral descrip- 
tions as fundamental to their efforts. Product 
development based upon behavioral specification 
is common in the descriptions of instructional 
materials promised by the new industry based edu- 
cational films [1] * 

Supported by such contributions to the field as Mager 1 s (2} 
programmed text on preparing behavioral, objectives and 
Gagne's (3} volume on learning, curriculum developers who 
affirm the value of behavioral objectives seek to have 'goals 
of education stated in behavioral terms so that the instruc- 
tor will know what the students are expected to be able to 
do after they have had the learning experiences. The 
Maryland Elementary Mathematics Program (MEMIP) exemplifies 
a curriculum project that is committed to reliably observable 

human behavior as the basis for development of instructional 

• 1 

materials (4, 5). One of MEMIP* s stated goals 7 is to demon- 
strate the selection of inservice materials for an instruction 
program based upon a set of behavioral objectives (6) . 

The idea of specif lying performance objectives in 
education did not originate in the 1960 { & , Bobbitt wrote 
in 1918 i 



Human life, however varied, consists in its per- 
formance of specific activities. Education that 
prepares for life is one that prepares definitely 
and adequately for these specific activities. 
However numerous and diverse they may be for any 
social class, they can be discovered. This requires 
that one go out into the world of affairs and dis- 
cover the particulars of which these affairs 
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consist. . These will show the abilities, habits, 
appreciations, and forms of Knowledge that men 
need. These will be the objectives of the cur- 
riculum. They will be numerous, definite, and 
particularized. The curriculum will then be that 
series of experiences which childhood and youth 
must have by way of attaining those objectives [7] , 

Ralph W. Tyler and his associates were concerned in ,”‘934 with 

the objectives of education and their relationship to the 

measurement of achievement. Xn a 1934 article, Tyler mpde 

the following comment on characteristics of educational objec 

tives which he considered desirable tor the purposes of 

evaluation* 

Bach objective must be defined, in terms which clar- 
ify the kind of behavior which the course should 
help to develop among the students? that is to say, 
a statement, is needed which explains the meaning 
of the objectives by describing the reactions we can 
expect of persons who have reached the objective. 

This helps to make clear how one can tell when the 
objective is being attained since those who are 
reaching the objective will be characterized by 
the behavior specified in this analysis [8] . 

By the second half of this century, many individuals 
placed great emphasis on the need for specifying educational 
goals in terms of what students will be able to do after the 
learning experience (9, 10, 11). The Mid-Century Committee 
on Outcomes in Elementary Education, sponsored by the United 
States Office of Education, Educational Testing Service, the 
Russell Sage Foundation, and the Department of Elementary 
School Principals of the National Education Association 
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attempted to identify desirable objectives of elementary 
education (12)* A similar effort reported by French (13) 



was made for secondary schools. Bloom's Taxonomy of Educa - 
tion a 1 Ob j e c t .1. ve s was another effort to define intellectual 
abilities in behavioral terminology. BlOom stated in a 
description of his effort to produce a classification of 



educational outcomes s 



What we are classifying is the intended behavior 
' of students — the ways in which individuals are 
to act, think, or feel as the result of partial- 
pating in some unit of instruction [3.4] . 

A major source of research in curriculum design that 
has emphasized specifying precise behavioral curriculum 
objectives is the research of the military services* Gagn<£ 
(15) summarized an experimental study of the training of 
electronic maintenance personnel that was reported by French. 
Forty graduates of a course in the mechanics of an airborne 
bombing navigational system (called the K-system) were given 
additional instruction in tracing the flow of information 
through the system as exemplified in a number of equipment 
problems. One-half of the group received this instruction 
on an actual system while the other half received the instruc 
tion on a training device called the MAC trainer. The addi- 
tional instruction was designed to help the students acquire 
the behaviors needed for diagnosing malfunctions of the 
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K-system. An analysis of the objectives prior to the 
experiment had revealed that the objective of successfully 
performing troubleshooting on the K-system was not adequately 
represented in the regular course of instruction. Results of 
the experiment indicated that the instruction which was 
focused upon specific behavioral objectives was effective 
in improving the performance of the mechanics. ( 

Two studies related by Smith (16, 17) reported the 
effectiveness of specifying objectives for training purposes 
that are based on job analysis, A study of the required 
performance of the rifleman in combat resulted in the deve3 r ~ 
opment of the TRAINFXRE program. The study revealed that 
among the rifleman's major difficulties in combat were the 
tasks of locating and identifying targets. The old method 
of training the riflemen provided no practice in identifying 
targets. The TRAXNF1RE range, established as a result of 
the study, enabled the soldier to obtain specific training 
in target detection. The second study related by Smith 
revealed a savings in instruction and learning time when 
a course for ordinance fire control, technicians was based 
upon the specific behaviors that the technicians were expected 
to perform on the job. The study found that graduates of a 
four hundred hour course based upon training for specific 
job behaviors were as proficient in electronic troubleshooting 
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as graduates of the regular thousand hour course. An 

analysis of the job the soldier was expected to perform 

yielded the behavioral objectives for the experimental 

training in each of the two studies mentioned. Commenting 

on the basic source of training objectives, Smith stated s 

The performance required by the soldier in his job 
is the basic source of training objectives. The 
key question is, "What must this soldier be able 
to do in order to do his job well?” It is highly 
important that the soldier be taught only the 
things he needs for doing his job? teaching him 
things that are irrelevant, to the job or teaching 
the wrong things can be very costly [18] • 

The training research conducted by the armed services 
has implications for education. Educators have recognized 
the value of clearly defined objectives for the classroom 
teacher as well .as for curriculum developers, Gagn<§ (19) 
has argued that a decision needs to be made about the nature 
of the change in behavior sought before a decision is made 
concerning the kind of learning situation needed to bring 
about a particular change in behavior. Lindvall argued for 
curriculum developers to define their goals in terms of what 
the student will be .able to do at the end of an instructional 
activity: 

Although curriculum plans must typically describe 
classroom activities that will be carried out. by 
teachers and pupils and must describe the subject 
matter content that provides the basis for lessons, 
the plans must include more than this. If such 
plans are to provide the type of direction that 
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will give the greatest assurance that there will 
be changes in what pupils learn, they should 
include statements that tell what, the pupils will 
be able to do after they have had the suggested 
learning experiences [20] * 

Lindvall's argument was supported by Kurtz, a professor of 
botany at the University of Arizona, when he provided anec- 
dotal evidence of the effectiveness of behavioral objectives 
in the classroom situation: 

I 

But in my own classroom experience, I have found 
that students acquire as many, and perhaps even 
more, facts when the course is designed around 
behavioral objectives than when factual content 
is emphasized. Because the students feel they 
are ,r doing" and "accomplishing" things when behav- 
ioral objectives are set, the number of facts 
learned per student appears to increase consid- 
erably along with the acquired behaviors. Appar- 
ently students receive satisfaction from doing 
science rather than telling about what science has 
already done, and this satisfaction somehow stimu- 
lates the acquisition of more facts [21] . 

The literature in support of behavioral objectives 
sepms to suggest that a major benefit to be derived from 
stating educational objectives in behavioral terminology 
■is that the type of learning that is to be undertaken by 
the student, and the required conditions of learning, are 
greatly clarified. Gagn<§ has argued that decisions con- 
cerning the type of instruction to be employed in attaining 
stated behavioral objectives 



. * . can usually not be made for an entity of 
learning as large as a "topic.” Instead, they 
need to be made for each, of the individual 
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learning acts that collectively make up a topic, 
arranged in a hierarchical manner [22] . 

The next section discusses the role of such learning hier- 
archies in curriculum design. 



LEARNING HIERARCHIES AND ' 
CURRICULUM DESIGH 



In a report: of a study of mathematics learning in 
1962 Gagnd (23) used the term “learning hierarchy u to refer 
to a set of specified intellectual capabilities having, 
theoretically, an ordered relationship to each other. Gagn£ 
hypothesized that tasks to be learned can be analyzed into 
a hierarchy of subordinate learning tasks which are related 
to each other in the psychological sense that the learning 
of some is prerequisite to the learning of others. Gagn£ 
found in a learning hierarchy for tasks on the addition, of 
integers that there was positive vertical transfer from one 
subordinate task to another. The findings of the study 
revealed that success in achievement of the final task of 
the hierarchy was highly corx*elated (.87) with the number 
of subordinate tasks which were acquired. Other studies by 
Gagne (24, 25) verified the finding that the learning of 
higher-level intellectual skills was dependent upon the 
previous mastery of prerequisite lower- level intellectual 
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skills. In a presidential address at the 1968 conference of 
the American Psychological Association Gagne emphasized the 
behavioral characteristic of the tasks which make up a 
learning hierarchy? 

The question is, what exactly are these entities, 
sometimes called capabilities, that make up a 
learning hierarchy? The answer I wou Id now give 
is the following. They are intellectual skills , 
which some writers would perhaps 1 call co gnitiv e 
strategies . What they are not is just as impor- 
tant. They are not entities of verbalizable 
knowledge. I have found that when deriving them, 
one must carefully record statements of "what 
the individual can do, " and just as carefully 
avoid statements about "what the individual knows" 

[26} . 

A study by GagnS and Bassler (27) found support for 
the hypothesis that such learning hierarchies as referred to 
in the previous paragraph aided retention of learned intel- 
lectual capabilities. The study measured immediate achieve- 
ment of initially learned intellectual skills (or behavior) 

I 

in non-metric geometry and retention after a nine-week 
interval. This study, while investigating other variables 
on the learning process, presented the topics in a sequence 
based on a hierarchy of learning sets in which acquisition 
of subordinate sets were required in order to learn the 
behavior on the next level of the hierarchy. Gagne and 
Bassler found that after exposure to a carefully constructed 
instructional program the skill acquired by a student to 
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perform , the terminal task. was highly resistant to forgetting, 
Utilization of the learning hierarchical approach to 
instruction has been made in the development of an elementary 
science curriculum called Science — A Process Approach , This 
curriculum for children in kindergarten and grades one 
through six, has been developed by the Commission on Science 
Education of the American Association for the Advancement of 
Science, Specific references to the learning hierarchies of 
Science — A Process Approach have been published by Walbesser 
(28), Walbesser and Carter (29), the commission on Science 



Education Newsletter (30), and the Xerox Corporation (31). 
Gagnd, discussing the utilization of learning hierarchies in 



the curriculum, said: 

The behavioral hierarchies constitute the 
,f skeleton" of Science — »A Process Approach and the 
rationale for selecting and ordering the sequence 
of exercises. Thus the behavioral hierarchies 
orient the teacher to the purposes of the program, 
or of any portion of it. The teacher may examine 
the progression of behavioral development depicted 
in these hierarchies, and derive from them a view 
of where teaching starts and where it is expected 
to go [32] . 

The Maryland Elementary Mathematics Inservice Program 



(MEMIP) , mentioned earlier in reference to its stated goal 



to demonstrate the selection of 



inservice materials for the 



instructional program based upon the set of behavioral objec 
fives, also is committed to use of learning hierarchies as 
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an effective basis for curriculum design* The following 
stated objectives of MEMIP (33) exemplify the program's 
commitment to learning hierarchies as well as behavioral 
objectives ; 

Develop a set of behavioral objectives and 
behavioral hierarchies for an inservice 
instructional program in mathematics for 
elementary school teachers. 

2. Demonstrate the selection of inservice 
materials for the instructional program 
based upon the set of behavioral objectives. 

3. Demonstrate that the instructional program 
can effectively be ordered on the basis of 
the learning sequences determined by t’he 
behayioral hierarchies. 

4. Demonstrate the acquisition of these behav- 
iors by the 

(1) Inservice Leaders — Participants in 
inservice instructional program in mathe- 
matics held at the University of Maryland. 

(2) Local Teachers^-Participants in local 
inservice instructional programs in mathe- 
matics directed by the inservice loaders. 

On the basis of the experimental research by Gagne 
and his co-workers, the developmental research by the Com- 
mission on Science Education of the American Association 
for the Advancement of Science, and the developmental 
research by the Maryland Elementary Mathematics Inservice 
Program, the hierarchical arrangement of learning sets 
appears to aid the learning of intellectual skills. 
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BEHAVIORAL OBJECTIVES , LEARNING 
HIERARCHIES AND THE LEARNER 

The literature reported in this chapter has been pri- 
marily focused upon the need of the curriculum designer and 
the teacher to know the desired expected outcome of the 
instruction in terms of behavioral objectives. What would 
foe the effect on the learner if he were informed of the behav 
ioral objectives? According to Gagne, telling the learner 
what is to be his performance when he has learned his lessons 
is a function performed by directions that seem to be very 
important to the learning process. Gagne (34) has also 
hypothesized that instructions in a learning situation ful- 
fill the following functions: 

1. They inform the learner of the performance that 
is expected of him. 

2. They stimulate recall of subordinate knowledge. 

3. They guide the learner's thinking. 

He has argued that the conditions of the learning situation 

are not satisfied, unless there is 

. . „ some instruction , which includes the steps of 
informing the learner about the expected form of 
the performance expected, encouraging recall, and 
cuing the proper sequence of acts » • . [35] . 

Hager observed that: 

An additional advantage of clearly defined objec- 
tives is that the student is provided the means 
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to evaluate his own progress at any place along 
the route of instruction, and is able to organize 
his efforts into relevant activities. With clear 
objectives in view, the student knows which activi- 
ties on his part are relevant to his success, and 
it is no longer necessary for him to “psych out” 
the instructor [36] . 

Tyler had this to say about the importance of behav- 
ioral objectives from the point of view of the student: 

When the objectives are clearly defined and under- ( 
stood by the student, he can perceive what he is 
trying to learn [ 37 ]. 

Otherwise, he continued, a student must do what a survey of 
100 students at the upper elementary and secondary school 
levels revealed. Almost all the students stated that they 
found out what they were to learn from three different 
sources: the textbooks and workbooks, what the teacher 

did in class, and the advice of other students. 

Gagne (38) stated .in 1964 that there was not much 
formal evidence to be found for the prediction that the prob- 
ability of the learner attaining a solution will be reduced 
if instructions do not enable him to identify the desired 
terminal performance. In 1967, Smith ( 39 ) conducted experi- 
mental research in which he gave printed instructions 
concerning the expected outcome of each mathematics lesson 



to one group of slow learners while another group of slow 
learners was not given this instruction. Smith found no 
significant difference in the performance of the two groups 




■eae 



20 



, on an achievement test. In 1968, Engel (40) conducted a 

study that found data to support the hypothesis that students 
will achieve higher on an achievement test if they are told 
in advance what are the objectives of each activity. She 
used material that was not organised around a learning hier- 
archy. Also, she found data to support the hypothesis that 
students will achieve higher on a retention test if th.*f?y are 
told: in advance the objectives of each, activity. Because 
Engel did not use the repeated measures analysis appropriate 
for studying retention effects (41) her findings may not 
have been conclusive in terms of retention benefits. 



SIGNIFICANCE OF THE INVESTIGATION 



As previously mentioned, the study is investigating 
the effect on learning and retention of informing students 
of the behavioral objectives and the. learning sequence of a 
unit of instruction. 



The results of the research by Gagne and his asso- 
ciates, by the Commission on Science Education of the 
American Association for the Advancement of Science, and 
related research conducted by master's candidates at the 



University of Maryland suggest that the following question 



should be investigated s 
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If a group of students is informed of the behavioral 
objectives and the learning hierarchy of a unit of 
instruction and another group of students receiving 
the same unit of instruction is not so informed, 
will there be differences in effect. on learning and 
retention? 

Authorities claim that teachers and curriculum devel- 
opers need to identify the behavioral objectives of instruc- 
tion in the framework of a learning hierarchy* Advocates 
such as Gagne? and Walhesser have hypothesized that such 
identification aids the instructor to not on3.y know what 
learned, behavior he wishes the student to acquire, but also 
to know in what hierarchical sequence or sequences each 
subordinate behavior may be taught and learned in order for 
the next higher level behavior to be acquired by the student. 
There may be more than one learning hierarchy for teaching a 
particular performance; the claim is that a learning hier- 
archy should be used. In addition, the advocates of behav- 
ioral objectives claim that since the instructor has 
identified the learned behaviors he wishes the student to 
acquire, he then is able to evaluate the success of the 
instruction by Whether or not the learner has acquired the 
desired behaviors. 

After completing her study, Roberta Engel made *~his 
observation: 

. . . at no point was the learner ever made aware, 
by means of direct observation, of the learning 
sequence. One might question, whether differences 
in achievement exist between learners who are 
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informed of the objectives of the lessons accom- 
panied by the learning sequence and those who are 
informed of the objectives of the lessons only 
[42] * 

The study conducted by the author, differs from those reported 
in the literature by the point of emphasis. While utilizing 
the results of earlier research, the author's research shifts 
the emphasis from the benefits to be derived from the 
instructor knowing the objectives and the learning hierarchy 
to the benefits to be derived from informing the student of 
the behavioral objectives and the learning hierarchy. This 
research seeks "to establish the benefit, in terms of learning 
and retention, of informing the student of the behavioral 
objectives of the instruction and. of the dependent relation- 
ship the subordinate objectives have to each other and to 
the terminal objective. 



HYPOTHESES TO BE TESTED IN THE STUDY 



From the literature review it seems reasonable to 
expect that those students who are. informed of the behavioral 
objectives of an activity will perform higher in achievement 

i 

and retention posttests than those students who are not so 
informed (43)* Moreover, it appears 1 ike ly that students 
who are informed of the activity's place in the hierarchical 
learning sequence in addition to being informed of the 
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behavioral objectives of the activity will perform higher on 
achievement and retention posttests than those who are 
informed just of the behavioral objectives of the activity. 

This research study is designed to determine whether 
for a specific population with specific treatments data can 
be obtained to support the above expectations. Accordingly, 
elementary majors in a four-year college were randomly, 
assigned to the four treatments (including a control treat- 
ment) delineated below. While receiving different informa- 
tion about the behavioral objectives and the hierarchical 
learning sequence, all four groups received the same set of 
self-instructional text material, covering a mathematical 
unit of instruction. The first treatment listed, T, , is 
the control treatment. 

The four treatments are defined as follows: 

— self-instructional, text material on a 
mathematical unit. 

— self-instructional text material on a 
mathematical unit with the objectives 
given before each, activity in the unit. 

T - — self-instructional text material on a 
mathematical unit with students informed 
of the learning hierarchy at the beginning 
and at the end of the unit • 

T, — -self-instructional text material on a 
4 

mathematical unit with students informed: 

(a) at the beginning of the unit of the 
learning hierarchy for the instruc- 
tional unit, and 
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(b) at the beginning of each activity 
of the objectives of that activity 
and of that activity's place in the 
hierarchical learning sequence. 



The research hypotheses 



associated with the question in the 



previous section and which reflect the 



stated expectations 



of this section are: 



Research Hypothesis I s Giving students statements 
of the behavioral objectives (with examples) before 
each activity of an instructional unit (T 0 ) results 
in higher achievement scores for the students so 
informed than those students who are given no infor- 
mation beyond the actual instruction unit activity 
(T X K 

Re sear ch By poth e s i s 2 % Giving students copies of 
the learning hierarchy with examples of sequence 
cells at the beginning and at the end of an 
instructional unit (T ) results in higher achieve- 
ment scores for the students so informed than for 
those students who are not given any information 
beyond the actual instructional unit activity (T^ ) . 



Research Hypo th e s i s 3 s Giving students statements 

of the behavioral objectives (with examples) and 

copies of the learning sequence before each activity 

of an instructional unit (T.) results in higher 

4 . 

achievement scores for the students, so informed than 
for those, who are not given any information beyond 
the actual instructional unit activity (T^) . 



Research Hypothesis 4 : Giving students statements 

of the behavioral objectives (with examples) and 

copies of the learning hierarchy before each activity 

of an instructional unit ’ {'IP ) results in higher 

achievement scores for students so informed than 

for students who are given only statements of the 

behavioral objectives (with examples) before each 

activity of an instructional unit (T v ) * 

2 
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* Giving students statements 
of the behavioral objectives (with examples) and 
the learning hierarchy before each activity of an 
instructional unit (T.) results in higher achieve- 
ment scores for students so informed than for stu- 
dents who are given only copies of the learning 
hierarchy with examples of sequence cells at the 
beginning and at the end of an instructional unit 

<* 3 >. 

M§,§arch Hypo thesis 6 s The differences in achieve- 
ment scores resulting from the four treatments are 
not identically reflected at each ability level. , 

B^tg.gPqh._H ypQt h e si s 7 s The four treatments have 
differential effects on the over-all |>erformance 
of students. 



B ggg gPjgh J^ lypoth es i s 8 : The four treatments result 

in different rates of forgetting. 

The differences in over-all 
performance scores resulting from the four treatments 
are not identically reflected at each ability level. 



DEFINITION OF TERMS 



For the purposes of this study these definitions are 



provided: 



MMljmigti ve variables . The written information 

given the students informing them of the behavioral objectives 
and the learning hierarchy of the unit of instruction j the 
time interval between the completion of the instructional 
unit and the administration of the posttests. 
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Respondi n g variable * The scores obtained by the 

f 

students on the matheiaati.es performance test. 



Inform . The procedure of giving the student written 
statements of the behavioral objectives with appropriate 
examples of the tasks and/or giving to the student a printed 
copy of the learning sequence with or without a written 
description of the place in the sequence of the objective' 
of each activity in the unit of instruction. 



Instruct i on a 1 u n 1 fc . A collection of activities 
designed to assist the learner to acquire the stated sub- 
ordinate and terminal behavioral objectives. 



Beh ay 1 oral ob j ect i ve «. 



The objective of 



expressed 



in terms of the behavior the student 



an activity 
is to acquire. 






Te rmi n a ,1 h eh a v i or * 



The behavior the learner is 



expected to be able to exhibit after some specified instruc- 
tion and for which there are one or more behaviors the learner 



must acquire as prerequis 



ite« 






and for which there, does not 



exist in the particular learning hierarchy a 



suoe r or d x n at e 



behavior. 



Hypothesis of learning dependency . A collection 
consisting of one terminal behavior and one or more immediate 
subordinate behaviors. 
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Learn 1 ng h i e r ar chy . A cumulative learning sequence 
made up of hypotheses of learning dependency. 

Retention . The number of learned behaviors that are 
remembered over a specified time interval as determined by 
scores of performance measures. 

Rate of forgetting . Hie change over time in the, 
scores made on the immediate posttest and the scores made 
on the same posttest administered after a delay of two 
weeks . 



Over-all performance . The score obtained when the 
scores made on the two posttests by a student in the experi- 
ment are summed. 

Identify . The students select (by shading or plotting 
on' a sheet of paper) the correct set of points on a number 
line or on a Cartesian plane. 

Name. The student supplies the correct identifying 
word or symbol (in written form) for a set of points on a 
number line or on a Cartesian plane. 

t 1 

Construct . The student generates a drawing which 
identifies a designated set of conditions. 
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Compu te « The student determines or ascertains by 
mathematical means (e.g„, Given x « 2 , confute y when 
y « x + 3) . 
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CHAPTER III 



* 



RESEARCH PROCEDURE 

This chapter presents a detailed description of the 
five phases of the research procedure. The first section 
deals with the experimental design * The second section, 
describes the development of the treatment materials and 
the criterion instruments. The third section covers pro- 
cedures used in selection and assignment of subjects. The 
experimental procedures are detailed in the fourth section 
and the final section describes the statistical designs 
employed in analysis of the data. 

EXPERIMENTAL DESIGN 

V 

Two statistical designs, treatments -by -levels analy- 
sis of variance and repeated measures analysis, were used in 
■this study. The accompanying experimental design was of the 
following f orm t 

KL - 22 R* T ** ' 0 7 C* 

1 1X2 

N 0 « 22 R* T CL 0 

N « 22 R* T 0 0 

nit- 
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N, « 22 R* T 0, 0 

4 -4X2 

*The students were blocked first on levels 
of ability and then were randomly assigned 
to the four treatments. 



** Control treatment „ 

This paradigm indicates that fa) the students were classified 
initially into levels of ability? (b } after they were classi- 
fied into levels, the 88 students were randomly assigned to 
four groups; (c) one group was identified, as the control 



group and received treatment T^? (d) the second group received 

treatment T , a third group received treatment T, , and a 
fourth group received treatment T. ? (e) an immediate, posttest 

was administered providing observations Q_ ? and (f) a delayed 
posttest provided observations 0 „ 



This experimental design was selected because? 
1. the design eliminated a pretest, hence the 



threat of the pretest being a confounding 
factor for the experiment was avoided? 

2. the prerequisite of random assignment would 
be satisfied? and 

3* the precision of the experiment would be 

increased by blocking on levels of ability. 



INSTRUMENTAL ON 



The two types of instruments used in this study were 



instructional in s t rume nt s 



and criterion instruments. 



The 
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instructional i. nstrumonhs fonai af***, 1 ? ■ •» , , 

‘ uuu ' s consisted of the treatment materi 



als for the experiment and included: 

1. self-instructional text material for a unit 



of instruction in mathematics 



2* a learning hierarchy for the unit of instruction, 
3* written statements of the behavioral objectives 



of each activity in the instructional unit, and 
4* written descriptions of the place in the learn- 



ing hierarchy of each activity in the unit of 



instruction, 



These materials were constructed specifically for this study. 
The criterion instruments included a performance test 
designed to measure the ability of the students to exhibit 
the terminal behaviors of the learning hierarchy, i-he per- 
formance test was used as the immediate posttest and as the 
delayed posttest, m addition, quizzes were constructed and 
administered to the students after completion of each activ- 
ity of the instructional unit. The first part of this 

_tion describes the procedure used to construct the treat- 
ment materials. The second part of the section discusses the 



construction of the criterion instruments. 



Treatme nt Materials 



hierarchy . A learning 

hierarchy consisting of the terminal behavior, its identified 






subordinate behaviors# and the hypothesized dependencies 

k 

among these behaviors was constructed as the first step in 
the development of the treatment materials. The terminal 
behavior of the hierarchy stated below reflects a topic 
which is part of the Math 205 syllabus at Towson State Col- 
lege. It is written in terms of what the student is to be 
able to do at; the end of the mathematical instructional 
units 



GIVEN a system of two relations 
of the type in Set A? CONSTRUCT 
a graph of its solution set and 
NAME the solution set in terms 
of the U ox H of points# line 
segments# rays# half-lines# 
angles, or triangles. 

The complete learning hierarchy# named Learning Sequence for 
the benefit of the students, is shown in Figure. 1 on page 37. 

The construction and validation of the learning hier- 



archy included twelve modifications 



of the hierarchy initially 



proposed . 



The majority of the modifications 



were the result 



of reappraisals of the terminal objective of the unit of 



instruction. 



Each time the terminal objective was 



redefined 



in an attempt to (a) adhere to the requirements of the sylla- 
bus of the college mathematics course (of which the unit of 



instruction was a part), and (b) adhere to the three-week 



period available for the instruction# 



several mod i f ic at i ons 



of the learning hierarchy were required. 



1.1 AIMING SI yul-HOi: 



GIVI M « system of two telnf f oii«t 
of (lie typo In Sot A {CONSTRUCT 
n graph of itr. solution sot and 
NAMI: Hio polutlon act in terms 
of the* U or 0 of points, lino 
segments, rays, half-lions, 
nnglen, or triangles. 



A 



I 
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GIVEN l hr* graph of a system 
of two relations of the* 
typo in Sot A f NAME tho so- 
lution set in terms of the* 

U <>f 0 points, lino, 
segments , rays , hnJf-linen, 
angles, or triongles. 



GIVEN the graphs of two 
relations of the type 
in Set A; IDGNWY by 
shading the 0 of the 
two graphs. 






B 



GIVEN two relntir.no 
of the typo in Set A; 

CONSTRUCT a graph 

of the eolation ect 
of each relation, 



B 



i 



GIVEN « fig ire showing 
the R of graphs of 
two relations of the. 
type in Set A; NAME 
the set of points 
which is the fl of the 
two graphs in terms of 
the. U or fl of points, 
line segments , rays , 
half-lines, angles, or 
triangles. 



GIVEN a relation 
from Set A, 

CONSTRUCT a graph of 
its solution act, 



A 



"WwnritWNiMil 



GIVEN the graphs of 


B 


GIVEN o relation from 


relations from Sc* t A 
with the shaded re- 




Part 1 of Set A , 


glonn or half-planes 




CONSTRUCT a table of 


deleted; IDENTIFY by 




ordered palra froi 


shading the half- 




which the graph of 


planes or regions 




the relation could 


which satisfy the in- 
equality for each re- 
lation. 




be constructed. 




Set A: 


Set B: 


Part 1. 


'(x,y) | y £ |x + a| , x real.} 
(x,y) | y > x + b , x real } 
(x,y) ! y2 c -* x, x realnj 


y - |x 4 a| 
y - x 4 b 
7 m c - x 


Part 2. | 


f(x,y) | y> d, x real! 
| (x ,y ) 1 X> e, x reolj 


Note: « 9 b f and c are integera. 


Note: > may be replaced by •*,>,<, or £ ; 

a, b, c* d, and c art Integers. 






... PX61JRB 


i 

■**~***m r.' ■ v , ... .v? ■> . 
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Upon completion of the ninth modification, a group 
of eleven University of Maryland students was taught in a 
conventional classroom setting the skills of the hierarchy 
during a one-day session. The eleven students received 
three hours of instruction before they were tested on their 
ability to perform each task in the then current hierarchy. 

i 

After the group of eleven students were taught and tesrtied, 
the consistency, adequacy, and completeness ratios were cal- 
culated according to the validation procedures described by 
Walbesser (1). A value of 0.80 was selected as an acceptable 
level for all ratios. The hierarchy was modified in an 
effort to improve it at the points that did not meet the 
0.80 criteria for all ratios. A second group of eleven 
students was taught and tested using this tenth version of 
the hierarchy. This procedure was continued for a third and 
a fourth group of students. The third and fourth groups 
were taught for four hours and tested for a period of two 
hours. After the fgurth group had received instruction based 
upon the twelfth version of the hierarchy and had been 
tested, the hierarchy was found to be valid in terms of 

, i 

the consistency, adequacy, and completeness ratios except 
for two completeness ratios which fell below the 0.80 cri- 
terion. The ratios are shown on the learning hierarchy in 
Figure 2 on page 39. The two completeness ratios may have 
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(CONSISTENCY, 



U.AIvHING GLQULNCL 

ADEQUACY, AND COMPLETENESS RATIOS) 




Set A: 




Sec B: 


Part 1. 


(x,y) 1 y 2 lx + a 1 , x real} 
(x,y) | y > x + b x real} 
(x,y) | y > c - x, x reals} 


y ■ | x + a J 
y ■ x + b 
y “ c - x 


Par c 2 . 


(x,y) 1 y > d, x real } 
;(x,y) 1 y > c, x real < 


Note: a, b, and c arc lntcgcro. 


Note: > be replaced by *■», > , or < ; 




a i b , c » 


d, and c are Integers. 





Ratio Legend: 
Consistency x- 
Adequacy A 
Completeness q 



been low because of the relatively short time (four hours) 
available to the students to learn the behaviors of the 
hierarchy. Since the behaviors in the hierarchy were to be 
taught during eight consecutive class days over a period of 
three weeks, a decision was made to use the hierarchy in the 
form shown in Figure 1 on page 37. Recognizing that a hier- 
archy which is valid under one teaching situation may pot be 
valid under a different teaching procedure, a decision was 
made to determine the validity of the hierarchy in the 
instructional setting of the experiment. 

In order to obtain groups of students which appeared 
to be homogeneous with the sample of students subjected to 
the treatments of the experiment, the investigator paid each 
student in the four groups which were used to* validate the 
hierarchy a wage for his time in the project. The students 

V 

used for the hierarchy validation were enrolled in Mathemat- 
ics 31 at the University of Maryland. Math 31 is the second 
course of a two-semester sequence of a college mathematics 
course designed for elementary education majors. As men- 
tioned in the section entitled Subjects (page 52), the 

« 

students to be used in the experimental treatments were ' 
enrolled in a similar course at Towson State College. On 
this basis, the groups of students used to validate the 
hierarchy were considered characteristic of the sample of 
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students used in the treatments of the experiment. 

Construction of the .instruction unit . The self- 
instructional text material for the instructional unit for 
this experiment was written, toy the investigator. The text 
material was designed and written to teach the behaviors 
shown in the learning hierarchy in Figure 1 on page 37. 

i 

No additional content instruction was made available to 
the students in class or outside of class. The material 
contained no homework assignments and was designed to be 
used only in the classroom. 

All the students in the four treatment groups 
received the same self --instructional text material. For 
brevity, the self -instructional text material will hence- 
forth be referred to as the text material. The students in 
the control group received only the text material. The 
students used in the other three treatments, T , T , and 

* m 3 

T , received the text material and additional information 
about the behavioral objectives and the learning hierarchy. 

A copy of the text material given to all the students 
in the experiment is shown in Appendix A. Each of the eight 
activities comprising the unit of instruction was bound in 
separate booklets. While the students in treatment T. 
received only the text material, the students 



in treatment 
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t ^2 re ceived, in addition to the text material, the following: 
1. A written statement of the behavioral objective 
of each activity in the instructional unit, 
and 2. A written example of the type, of task the 

students were expected to be 'able to perform 
at the end of each activity. 

Statements and examples of the behavioral objectives of each 
activity were given to the students in treatment T,, at the 
beginning of each activity as part of the self-instructional 



booklet. The first page of the self-instructional booklet 
for activity III is shown as Figure 3 on page 43 as an illus- 
tration of the type of statements provided the students in 
treatment T^ . A copy of the set of material given to the 
students in treatment is included in Appendix B. Because 
all students received the same text material, a copy of the 
text material is included only in Appendix A. A page insert 
is provided in Appendix B at the points where the text 
material was provided in the activity booklets. 

As previously mentioned, the students in treatment T 
received the same text material as the other students in the 



3 



experiment. In addition, the treatment T students were 

3 

given a copy of the learning sequence with examples of each 
task at the beginning and at the end of the unit of instruc- 
tion. The following statements were taken from one of the 
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Watch Out For the Objective of Lesson III I 

The £L2i*l or the ^jechive of Lesson III is to teach 
you to perform the following tasks 

GIVEN the graphs of combinations of two 
of the following sets of points on a line; 

points, line,.. , line segments, half-lines, 
or rays ; 

IDENIIFY their p| by shading on the line. 

Example of the type of task: 

GIVEN line MP , One set of points on 
line MP is represented abov e Sp while 
a second set of points on MP is repre- 
sented belo w Sf> . 



V 

% 



o 



M N 






> 



0 



P 






# 

IDENTIFY the fj of the two sets of points 
by shading line ®P in red over the appro- 
priate portion. 



o- 






Solution; 



M N 0 P, 





«IS~. 



— & 



FIGURE 3 

OBJECTIVE OP ACTIVITY HI 
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pages included in the first booklet received by the students 
in T : 

You now can know in ADVANCE what is considered 
important by the author. You know in advance; 

1* That the objective of this unit of instruc- 
tion is that you will be able to perform 
tasks of the type described in step 5 -A. 

2. That the author expect: s you to learn the 
sub-tasks described in the Learning 
Sequence before you learn the final task 
(step 5 -A) • 



3. That the author expects you to learn the 
sub -tasks and then the final task in the 
sequence shown on the opposite page [see 
Appendix c, page 304} . 



A complete copy of the materials given to the students in 



treatment T 



is provided in Appendix c. 



The text material 



insert pages 



a.re placed at the points where the text material 



was provided in the activity booklets. 

Besides the text material# the students in treatment 



T^ v received at the beginning of the unit 



of instruction a 



copy of the learning hierarchy 
task in the hierarchy# and des 



# a set of examples of each 



eriptive comments as in treat- 



ment IV . 

3 

beginning 



In addition# the T. students received at the 
of each activity a written ' statement (with exam- 



ples) of the behavioral objective of the activity and a 



written description of the 



activity k s place in the 



learning 



hierarchy. 
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The behavioral objective for each activity was pre- 
sented in T , in the same format as that used in treatment T . 
4 

The following example of the type of comments provided in 
about the place of the activity in the learning hierarchy is 
from activity IV: 

The place of this lesson in the Learning Sequence 
is shown in red on the OPPOSITE PAGE* Lesson IV is 
designed to teach, you the shills to perform the / 

tasks described in steps 3~A and 3-B. Acquiring the 
ability to perform the tasks of 3~A and 3-B will 
enable you to learn to perform the task of step 4-A 
in Lesson V* Yon might wish to look now in the 
green folder at an example of step 4-A. 

$ 

You will be able to perform the tasks of steps 
3 -A and 4-A in this lesson because you have already 
acquired the skill to perform the tasks of steps 
1-A and 1~B {shown in blue) [see Appendix P, 

, page 368] * 

A copy of the materials given to the students in treatment 
is shown in Appendix D. As with the other treatments, the 
text material insert pages are placed at the points where 

i 

i 

the text material was provided in the activity booklets. 



Criterion Instr ument s 

Construction of the quizzes . Quizzes consisting of 
from two to four problems each were constructed for adminis 
tration to each student in the experiment as he completed 
each of the activities. The quizzes were given for two 



reasons : 
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1. To provide data for a second validation of 
the learning hierarchy. 

2. To provide data on the students' awareness of 
the objective of each activity in the instruc- 
tional unit * 

Since the first validation of the learning hierarchy 
was done under quite different teaching conditions than the 
teaching conditions of the experimental treatments, a 
decision was made to determine whether the hierarchy was 
still valid under the new teaching conditions* The findings 
from the new validation calculations are provided in Chapter 
IV. 



The immediate purpose for informing students in this 
study of the behavioral objectives with and without the 
learning hierarchy was to enable them to be aware of the 
objectives of the activities in which they were engaged. A 
post-hoc analysis of the relationship between the students' 
level of awareness of the objectives and the students’ per- 
formance on immediate and delayed posttests was included in 
the plans for this study. The design of this post-hoc analy- 
sis is described later in this chapter under Statistical 
Analysis. The quizzes were designed to not only provide a 
measure of the students' awareness of the objectives of the 
activities but. also to motivate the students to pay attention 
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to the information provided about the objectives in each 
activity booklet (see Appendix E , page 397}, Those students 
in treatments T^, T^, and *£ received a version of the 
quizzes which included instructions to identify and work 
only those quiz problems which were examples of the activi- 
ties 1 objectives. Since one or more problems were included 
on each quiz which were not examples of the objective of the 

I 

activity, students who knew the objectives of the activity 
did not have to work all of the problems which were given. 

A copy of the quiz given after activity V to each student 
in treatments T^, T^# and is shown as Figure 4 on the 
following page for illustrative purposes,. A correct response 
on this quiz would have only included the circling of the 
number 3 and working problem 3. The students in treatment 
*^1 Jrece ^ ve< 3 quizzes containing the same problems with the 
written instructions deleted. The students worked all 
the problems on each quiz. Copies of all the quizzes of 
both versions are included in Appendix E. 

'Hie face validity of the quizzes was assured by 
having a one-to-one correspondence between the wording of 
the problems on the quizzes and the wording of the behav- 
ioral objectives in the learning hierarchy. The following 
comparison between the stated objective of sub-task 2-A in 
the learning hierarchy shown in Figure 1 on page 37 and 




i 
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, Lesson V — "Check-up" Questions 
Name 

Time: 10:00 ? 11:00 ? 12:00 ? 1:00 

INSTRUCTIONS: 



A. Circle the number of the problems which are 
examples of the objectives of this lesson, 

Pi ily the problems you circled. 

1. IDENTIFY, by coloring in red, the 0 of the two following 
graphs: 




2* NAME the f] set, shown in red, of the two following 
graphs. The f) set is to be named in terms of the 
(J or 0 of points, line segments, rays, half-lines, 
angles, or triangles: 




3. NAME the solution set of the system of two graphs. The 
solution set is to be named in terms of the U or fj of 

points, line segments, rays, half-lines, angles, or 
triangles. 




FIGURE 4 



ACTIVITY V QUIZ 
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problem No. 3 on the quiz for activity VII -a illustrates this 
one-to-one correspondence. Activity VH-a was designed to 
teach the students the skill to perform the behavior described 
in sub-task 2-A. Problem No. 3 on the quiz for activity 
VII -a was designed to test the students* ability to perform 
the skill of sub-task 2 -A after having been taught by the 
self-instructional materials in activity VU-a. 

' Sub -task 2 -As 



GIVEN the graphs of relations from 
Set A with the shaded regions or 
half -planes deleted? IDENTIFY by 
shading the half -planes or regions 
which satisfy the inequality for 
each relation. 

Problem No, 3 on the quiz for activity Vll-as 

GIVEN the relation £(x,y) | y > jx-lj, x real! 
and its graph with the shaded region deleted? 
IDENTIFY by shading the region which satis- 
fies y > [ x— 1 1 • 



' t 

L 







xz. 







The problems on the quizzes which were not examples' of the 
objectives of the activities were examples of problems which 
were used in the text material to establish the foundation 
for teaching the objective skills. Hence, it was assumed 



o 
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that the students who had access to the objective of each 
activity wou?d be motivated by the nature of the quizzes to 
take advantage of the information on the objectives by dif- 
ferentiating as they studied the text material between the 
matex*ial that dealt directly with the objective and that 
material whi *h played only a supportive role* The data 
obtained on the students' awareness of the objectives $re 
displayed in chapter IV. 

C< v istruction of the performance test , A pe r f < or m an c e 
test was constructed to determine whether or not the students 
in the experiment had acquired the terminal behavior of the 
learning hierarchy. The performance test was constructed for 
use as both the immediate posttest (achievement test) and the 
delayed posttest (retention test). The test consisted of 
seven problems, each of which tested the students' ability 

i 

i 

to perform the terminal task of the learning hierarchy-. Three 
versions of the test were constructed to provide some assur- 
ance that the scores on the tests reflected the students own 
work. The three versions differed only in the order that the 
problems were listed. Copies of each version are included in 
Appendix F. The students' reactions to the material used in 
the experiment, along with administrative information, were 
requested on the cover page of each performance test. Their 
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written reactions were not considered part of the performance 
test . 



The face validity of the performance test was assured 
by a one-to-one correspondence between the wording of the 
test problems and the wording of the terminal objective in 
the learning hierarchy. One set of instructions was given 
for all seven problems. The following comparison between the 
terminal objective and the test instructions illustrates the 
one-to-one correspondence in wordings 
Terminal task (5 -A} : 



GIVEN a system of two relations 
of the type in Set A? CONSTRUCT 
ci graph of its solution set and 
NAME the solution set in terms 
of the (J or fj of points, line 
segments, rays, half-lines, 
ang les , or tri. ang les . 

Performance test instructions; 

GIVEN the system of two relations 
in each of the following problems, 
CONSTRUCT a graph of the solution 
set of each system and NAME the 
solution set in terms of the 
U or f) of points, line segments, 
rays, half -lines, angles /or 
triangles . 



Care was taken to include on the test every type of relation 
in the Set A referred to in the terminal task. The test 
included a minimum of two relations of each type. Only one 
type of relation in Set A was used more than three times on 
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« test. Ilie one exception was the type of relation involv™ 

ing absolute values, which was used four times. 

The Kuder-Richardson procedure for estimating reli- 
ability was applied to the performance test scores to 
determine the reliability of the test under the four differ- 
ent treatments. The findings on test reliability are reported 
in Chapter IV., 

» 

SUBJECTS 

The target population chosen for this research was 

the set of all elementary education major students who 

enroll in the second semester of a two-semester sequence of 

college mathematics courses designed to teach the content 

material required for elementary school teachers. The 

available population was the group of 103 students enrolled 

in four of the General Mathematics 205 sections at Towson 

State College in Towson, Maryland. The Math 205 course is 

designed for elementary education majors and is described 

by the college bulletin as including 

... elements of algebra, basic geometry, graphs, 
applications of percent, proportion and variation, 
tight triangle relationships, logarithms, elemen- 
tary statistics, and new topics in mathematics [2]. 

Fundamental Concepts of Arithmetic 204 is the prerequisite 

for Math 205. The Math. 204 course includes: 

I O 
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. . . origins of numbers, structure of a positional 
number system, principles underlying the fundamen- 
tal operations, and computations with approximate 
numbers [3] . 

For most of the students in the experiment, the Math 205 
course was their second college mathematics course* 

The sample for this experiment, while chosen from the 

available population of 103 students, was essentially identi- 

7 

cal to this population* Those students within the population 
whc had received a grade of A, B, C, or D for Math 204 were 
identified as the sample* Some students within the four 
sections were transfers from other colleges and, hence, 
grades for Math 204 were not available* A total of 92 stu- 
dents of the 103 in the population had grades from A to D in 

Math 204. 

The students' grades in Math 204 provided a variable- 
for blocking which was highly correlated with the responding 

i 

variable (4). Hence, in order to increase the precision of 
the experiment (i.e., reduce the unaccountable variance), 
the students were blocked on levels of ability as reflected 
by the grades they made in Math 204* The ability levels 
were designated High for a grade of A in Math 204, Medium 
for a B in Math 204, and Low for either a C or D in Math 204* 
The blocking procedure resulted in 19 students in the High 
group, 36 in the Medium group, and 37 in the Low group. 
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Three students were randomly selected for deletion from the 
High group and one student was randomly selected for deletion 
from the how group* The resulting sample for the experiment 
consisted of 88 students with a distribution of 16 students 
in the High group, 36 in the Medium group, and 36 in the Low 
group. The students in each of the three groups were then 
randomly assigned to each of the four treatments, Ther^ were 
22 students in each of the four treatments. Table I shows 
the distribution of students to the various experimental 
conditions of the study. 

TABLE I 

•if CELL SIZES FOR T X L ANOVA DESIGN 



Treatments 



h ' High 
!> 



■p 

•H 



$ 



Medium 



Low 



T 

1 


T 

2 


T 3 


T A 

4 


’ 

n n = 4 


. n l2 “ 4 


n l3 ^ 


n s= 4 

14 


n 21 = 9 


n 22 " 9 


n ® 9 

23 * 


"24 = 9 


n 31 = 9 


n 32 * 9 


n as 9 

33 


n 34 = 9 



n. « 16 

X » 



n 2.= 36 



n_ « 36 

J « 



n , = 22 n - 22 n , ~ 22 n , ~ 22 , 

#x • / *4 
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EXPERIMENTAL PROCEDURES 

The unit of instruction, consisting of eight activi- 
ties with two activities having two parts, was administered 
by the investigator for eight consecutive class days. The 
random assignment of students to treatments resulted in the 
four treatments being represented. in each classroom. The 
students not included in the sample of the experiment 1 
received the materials of treatment . On the ninth day 
of the experiment, the students were administered a pre- 
viously announced performance test as an achievement test. 
Two weeks later the students received unannounced the same 
performance test as a retention test. Following the recom- 
mendation of Winer (5) each student received a different 
version of the performance test than the one tye had received 
two weeks earlier. This was done to control the. carry-over 
affects from the achievement test to the retention test. 

’ H 

% 

For clarity, henceforth in this paper the achievement test 
•'ill ulso be referred to as the immediate posttest and the 
retention test will often be referred to as the delayed 
posttest. 

On the first class day, the investigator taught all 

' 4 

the students in each of the four classes how to read a 
learning hierarchy. This was done as a self-contained topic 
presented as an educational novelty. During the process of 
teaching the students how to read a learning hierarchy, no 
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reference was made to the topic of the three-week instruc- 
tional unit. 

As an introduction to the three-week unit, the 
students were told that the self-instructional material that 
they would be using during the next three weeks had been 
developed at the University of Maryland,, In addition, they 
were told that different versions of che material were .being 
submitted for their use and appraisal. They were not told 
how the versions differed. The achievement test and the 
quizzes were announced at this time with the assurance that 
each would determine part of their final grade in the course. 
No mention was made of the scheduled retention test. 

The full time instructors of each class were in 
attendance at the first session to introduce the investi- 
gator as the temporary instructor for the next three weeks, 
the introductory remarks, the full time instructors 
left the classroom and did not attend any of the future 
sessions of the experiment. 

Each activity of the self -instructional unit was 
given to the students in a booklet format. Each booklet 

i 

was administered at the beginning of the class period. As 
the student completed the activity he returned it to the 
investigator * At no point was any student allowed to take 
a booklet home for study. After completing each activity 
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at their own pace, each student was administered the quiz 
for the activity. However, quizzes were not given after 
activities I, II, and III. Activity I was a review of sets 
and their union and intersection. The learning hierarchy 
constructed for the study was based upon the. assumption that 
the students in the study had the shill to identify the union 

t 

and intersection of sets. Hence, the review in activity 1 
was designed to provide support for this assumption and was 
not intended to help the students learn any skill in the 
hierarchy. Hence, a quiz was not given after activity I. 
Quizzes were not given after activities II* and III because 
of a delay in preparation of the quizzes. The students' 

t. 

V, 

ability to perform behavioral objectives of activities II 
and III were determined by including in the quiz for activity 
VIII assessment tasks for activities II and III. 

’*> The dates on which each activity, immediate posttest 

(achievement test), and delayed posttest (retention test) 
were administered aare listed below: 



April 


9 


Introduction, Activity I 


April 


11. 


Activity II 


Aj:>ril 


14 


Activity III 


April 


16 


Activity IV 


April 


18 


Activity V and VI 


Apr i 1 


21 


Activity Vila 


April 


23 


Activity VI lb 


Apr i 1 


25 


Activity Villa and VUIb 


April 


28 


Immediate Posttest 


May 


12 


Delayed Posttest 
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The four sections of Math 205 used in the study met on 

Mondays, Wednesdays, and Fridays at the fallowing times: 

1 10:00—10:50 A.M. 

Section 2 11:00—11:50 A.M. 

Section 3 12:00—12:50 P.M. 

Section 4 1.00- 1,50 P.M. 

t 

Sections 1, 2, and 4 met in the same building but in different 

rooms. Section 3. met in another building which was an eight- 

I 

minute walk from the first building. Those students who 
required additional class time to complete their activity 
booklets were permitted to attend additional class sessions. 
The topic selected for the study and the Spring 

i 

semester schedule of Towson State College made it. necessary 

to, limit the period between the immediate posttest and the 

‘f 

unannounced delayed posttest to two weeks instead of the 
proposed three weeks. During this two-week period the full 
time teachers did not review the mathematics topic used in 
the experimental study nor did they teach new material 
requiring the use of the skills learned during the experi- 
ment . 

STATISTICAL ANALYSIS 

t 

As noted in Chapter II, this study was designed to 
investigate several pair-wise comparisons among treatment- 
group means. The nine hypotheses stated in Chapter II on 



, pages 24 and 25 can be grouped into two areas of concern. 

The first six hypotheses are c Dncerned with pair-wise com- 
parison of the effects of four instructional treatments on 

achievement. The last three hypotheses (H_, H 0 , and H.) are 

7 8 9 

concerned with pair-wise comparison of the effects of the 
four treatments on retention in terras of over-all performance 
and rate of forgetting. The treatment -by- level analyses of 
variance was employed to determine whether the data of this 
study supported the first six hypotheses. An evaluation of 
the data in terms of the last three hypotheses was made 
utilizing a repeated measures analysis design. This section 

of chapter III deals with the use of these two statistical 

i 

designs in the study. 

t 

\ 

Treatment -by- level Analysis 
of Variance 

J Hays (6) stated that 

For any particular comparison, the test is more 
powerful when the comparison is planned than when 
it is post-hoc. ... 

Because planned comparisons are more likely to detect dif- 
ferences when they exist than the various post-hoc methods, 

t 

the hypotheses listed in Chapter II were stated before the 
data were collected for this study. Planned comparisons 
may be used in lieu of the over-all F test, while post-hoc 
comparisons are used as a supplement to an over-all F test 
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t which has shown significance. Hence,, the five planned pair- 
wise comparisons of the effects of the four treatments on 
achievement stated in hypotheses through were conducted 
instead of the over-all P test. In order to assure that the 
experimental design and the analysis were congruent, the 
schema recommended by Hopkins and Chadbourn (7) and Hays (8) 
for making c multiple comparisons among k treatment mefins was 
followed in this study. 

In order to increase the precision of the experiment 
involving the planned contrasts reduce the error term 

by accounting for some of the variance) , the treatment -by- 
levels analysis of variance design (T x L ANpVA) was utilized. 

■< 

As previously mentioned, the students in the experiment were 
blocked on the levels of ability reflected by the grades 
they made in Math 204. The ability levels were designated 
High, Medium, and Low. The students with an A in Math 204 
were placed in the High group, B in the Medium group, and 
• those students with a c or D in the Low group. The students 
in each ability group were then randomly assigned to one of 
the four treatment groups. 

« 

In order for the T x L ANOVA to provide a valid test 
of the treatment effects on achievement, efforts were made 
to assure that the following assumptions were met: 
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1. The students from each of the ability levels 
are randomly assigned to the four treatments. 

2. The variances of the student scores within the 
levels of ability are homogeneous. 

3. The data are independent, i.e., a given response 
is in no way affected by other responses. 

4. The students are drawn from a normal population. 

5. The n's of the cells are equal or proportional. 
The randomization assumption was met in the manner discussed 
in the preceding paragraph. 

Homogeneity of variances was tested by Hartley *s 

F test (9) , The findings are included in Chapter XV* 
max 

Peckham and Hopkins have stated that; independent 
responses : 

. . . are most adequately obtained by randomly 
assigning subjects to treatments, by adminis- 
tering identical treatments to individuals who 
/ s are insulated from their peers during treat- 
ment, . . . [10] . 

4 

The self-instructional format of the instructional materials 
provided for such insulation. It was assumed that the 

separate individual activity booklets would sufficiently 

* 

insulate the students from the responses of their peers. 
Because the role of the investigator in the class sessions 
was only administrative, his presence did not alter the 
conditions established for independent responses. 
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Ferguson had this to say concerning the robustness 

of the assumption of normality: 

For large samples the normality of the distribu- 
tions may be tested using a test of goodness of 
fit, although in practice this is rarely done. 

When the samples are fairly small, it is usually 
not possible to rigorously demonstrate lack of 
normality in the data. Unless there is reason 
to suspect a fairly extreme departure from 
normality, it is probable that the conclusions 
drawn from the data using an F test will not be 
seriously affected [11] . 

There appears, also, to be a specific advantage in the use 

of the analysis of variance with respect to the robustness 

of the normality assumption. Ferguson continued: 

One advantage of the analysis of variance is 
that reasonable departures from the assumptions 
v of normality and homogeneity may occur without 
seriously affecting the validity of the infer- 
ences drawn from the data [12] . 

All of the students in the target population were elementary 

education majors enrolled in the second semester course of a 

b 

two-course sequence in mathematics. Most of the students in 
the available population were freshmen and sophomores and all 
had met Towson State College's prerequisite requirement for 
taking Math 205. The assumption was made that the popula- 
tion from which the students were obtained was normal with 
respect to ability. 

Table I on page 54 illustrates the planned propor- 
tional n's in the cells. One student dropped out of the 
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• stu<3 Y because of illness. She was in treatment T and in 

the Low ability group. Ferguson stated in reference to cell 

frequencies for a two-way analysis of variance: 

Both the methods of expected equal and expected 
proportionate frequencies are in some degree 
approximate. Departure from equal n's in the 
former method and from proportionality of n's 
in the latter method will introduce some bias 
in the F test, the extent of the bias being 
related to the magnitude of the departures [13] . 

The loss of one student to this study was not considered a 

detriment to the proportional cell distribution. Since the 

magnitude of the departure from proportionality was so small, 

the possible resulting bias was considered to be negligible. 

The decision was made before the analysis of the 

• / 

V 

data to set the maximum probability of making a type-l error 
(a) at .05 . . 

An experiment -wise error rate was chosen by the 
investigator because it was considered desirable to be able 
to state that in all of the comparisons in this experimental 
’ stud y there was only an ot « .05 probability that a type~I 
error was made, choosing an error rate that was experiment- 
wise meant that regardless of the number of permis sable com- 
parisons carried out, the probability was no more than .05 
that one or more of the comparisons will turn out to be 
spuriously significant. 
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Repeated Measures Analysis 

The repeated measures analysis was used to analyze 
•the data obtained in this study to determine whether the 
data supported these three hypotheses: 

— The four treatments have differential 
' effects on the over-all performance of 
students. 

The four treatments result in different 
rates of forgetting, 

Hg — The differences in over-all performance 
scores resulting from the four treatments 
are not identically reflected at each 
ability level. 

The decision to use the repeated measures analysis was sup<r 
ported by research conducted by Kenneth H. Wodtke of The 

f 

Pennsylvania State University as part of a larger project 

funded by the U.S. Office of Education, under the Vocational 

Educational Act of 1963. .In a journal article devoted to a 

consideration of several procedures for studying long-term 

retention, Wodtke (14) reported that the repeated measure 

design, described by Grant (15) and Winer (16), seemed most 

appropriate for the study of differential rates of forgetting 

and over-all performance. Wodtke stated that a statistically 

significant over-all effect between treatments (as reflected 

in the differences in the over-all performance scores) 

. . . would indicate that one instructional treat- 
ment was generally superior to another. A statis- 
tically significant treatment -by-retent ion measures 




65 



W ° UM indlcate «»t the slopes of 

differed1i7?. CUrVeS ^ treatl " ent ««**. 

Similarly, a statistically significant levels -by-treatment 
interaction would indicate that the effects of the treat- 
ments on over-all performance were not identically reflected 
at each ability level. 

Congruence between the experimental design of £his 
study and the planned statistical analysis of the data with 
the repeated measures analysis was sought by the decision to 
follow the schema suggested by Hopkins and Chadbourn (18) 
and Hay- (19) for making c multiple comparisons among k 
treatments. Based upon experimental conditions of this’ 

Study and the Hopkins and Chadbourn schema, the Tukey-b 
method described by Winer (20) was included in the statis- 
tical design as the technique for locating significant dif- 
ferences between over-all performance means, in addition, 
the statistical design included the plotting of the slopes 
of the retention curves as a technique for determining which 
treatments resulted in the least rate of forgetting (i.e., 
improved retention) . Inspection of the levels-by-treatment 
interaction profiles was included in the statistical design 
as the technique for obtaining an indication of the relative 
effects within ability levels resulting from the four treat- 
ments (21). These profiles consist of graphically depicted 
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data showing changes in mean over-all performance scores 
across treatment methods separated by ability levels. 

The three-factor repeated measures analysis design 
described by Winer (22) was used as the model for this 
study. The three factors involved were: 

(a) the manipulated variable — the four 

instructional treatments? 

(b) the normative variable — the levels j 

of ability; 

and (c) the responding variable- — the posttests 

scores . 

A schematic representation of the design is shown in Table II. 



1 






TABLE II 

SCHEMATIC OF REPEATED MEASURES ANALYSIS DESIGN 







Posttests 






Immediate 


Delayed 




H i 


G 

HI 


G m 


T 

1 


M i 


g mi 


g mi 




h 


g li 


g li 



* 

* ' 





H 4 


G H4 


G H4 


T 

4 


M 4 


°M4 


G M4 




L 4 


G L4 


G L4 



but 



Each of the groups was observed under both posttests, 
each group was assigned to only one combination of treatment 
and level of ability. The notation G. . denotes the group of 
subjects assigned to the i,j treatment combination where i 
denotes the ability level and j denotes the treatment number. 
A student within group G_ would be identified by m(ij). 

This notation indicates that the subject effect was nested 
under both the treatment factor and the levels of ability 
factor. Since the subject factor (i.e., the variance of the 
characteristics peculiar to each student in the study) was 
nested under both the treatment factor and the levels of 

ability factors, there was no interaction between these 

, ¥ • 

latter factors and the subject, factor. 

The assumptions made for the repeated measures analy- 
sis were: 

1* The students from each of the ability levels 
were randomly assigned to the four treatments. 

2. The variances of the ability level means within 
the various treatments are homogeneous. 

3. The variance of the "interaction of posttests 
and ability levels within treatments" is a 
pooling of the variance of the scores in each 
treatment group about the treatment mean after 
the effects of posttests and the effects of 
ability levels within treatments have been 
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subtracted. These variances for each treat- 
ment group are homogeneous. 

4. The scores collected as data are normally 
distributed. 

The assumptions of homogeneity of variance were tested by 

the F test. The findings are included in Chapter IV. 
max 

Planned Post-hoc Analysis 

In addition to the planned post -hoc analyses outlined 
by the schema of Hopkins and Chadbourn and the plotting of 
the interaction profiles discussed in the previous section, 
another post-hoc analysis was made. Since the purpose of 
informing students in this study of the behavioral objec- 
tives with and without the learning hierarchy was to enable 

m I 

them to be aware of the objectives of the activities in which 
they were engaged, the following question is applicable: How 

did the students' level of awareness of the objectives affect 
their achievement test scores and over-all performance scores? 

Data were obtained from the quizzes given after each 
activity in order to provide an answer to the above question. 
The students in treatments T , T , and T were graded on the 

4 

number of the problems on the quizzes that they correctly 
identified as examples of the objectives of the activities. 

The students were graded in the following manner: those who 

k 

made a score of less than 25 were classified 0^, those with 
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a score of 26-50 were classified O^, those with 51-75 as 0^, 
and those with 76-100 as 0. . Ten points were added to their 
score for each problem correctly identified and ten points 
were subtracted from their score for each problem incorrectly 
identified. The score of each student determined in the 
above manner was referred to as the objectives test score 
for the student while that aspect of the quizzes which tested 
the students' awareness of the objectives was referred to 
as the objectives test. 

An analysis of data obtained from the objectives test 
was made to determine the correlation between the students' 
awareness of the objectives and their achievement test scores. 
Also, a correlation coefficient which measured the degree of 
linear relation between the students' awareness of the objec- 
tives and their over-all performance scores was calculated. 
Bt>th correlation coefficients are reported in Ch?*pter IV. 

The author expected the three treatments T^, and 

.T to have differential effects on the students' awareness 
4 

of the objectives. The analysis of variance statistical 
design was used to determine whether the data obtained from 
the objectives test supported this expectation. The findings 
from this analysis are presented in Chapter XV. Although 
there is no randomization involved in this type of analysis 
and, hence, no rigorous statement concerning statistically 

i 

* t 
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# significant differences can be made, the comparisons pro- 
vided some indication of the effect awareness of the 
objectives had on achievement test scores. 

RESEARCH ASSUMPTIONS 

In addition to the assumptions made with reference 
to the two statistical designs, the following assumptipns 
were made for this study: 

1. The learning hierarchy constructed' as the basis 

for the instructional unit was a valid hierarchy at the ,0,80 

/ 

level for the consistency, adequacy, ard completeness ratios. 

2. If the students in the available population were 

■f 

given sets consisting of integers, they could identify (in 
written form) the intersection and/or union of any two sets. 
Also, if the student were given three Venn diagrams, they 
abuld identify (by shading) the intersection of the three 
diagrams . 

3. The students could not perform the subordinate 
tasks on the bottom row of the learning hierai'chy constructed 
for this study before they were subjected to the treatments. 

4. The criterion instruments were valid measures of 
learned behaviors for the four treatments. 

5. Any differences observed in the performance of 

* 

the students in the four treatments were not a function of 
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the measuring insx, . stents, but were dependent on the instruc 
tional methods employed, 

6. The attitude and behavior of the principal 
investigator in his dealings with the students in the four 
treatment groups was unbiased. 

7. The treatment groups are representative of the 
target population. 

8. The treatments were applied as described. 

9. The different experiences the students may have 
had in their respective classes prior to the experiment 
would not override the effect of the treatments. That is, 
classroom effect would not be a confounding factor. 

10. Because additional class time was available to 
the slow student, the length of the self-instructional 
activities would not be a confounding factor. 
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CHAPTER XV 



FINDINGS 

The findings reported in this chapter in four sec- 
tions are related to the following topics: 

1. the validity of the learning hierarchy in the 
experimental setting, 

2. the reliability of the posttest and the reli- 
ability of the objectives test, 

3. the data analysis relevant to the nine research 
hypotheses stated in Chapter II, and 

4. the post-hoc analyses of the objectives test data. 
The third section is divided into two parts. The findings 

I 

related to the comparison of the effects of the four treat- 
ments upon achievement scores are reported in the first part, 

entitled Treatment~by~ Level Analysis of Variance . In the 
* 4 

second part of the third section, entitled Repeated Measures 
' Analysis , the findings pertaining to the comparison of the 
effects of the four treatments upon over-all performance and 
rate of forgetting are reported. 

LEARNING HIERARCHY VALIDITY 

The data for assessing the validity of the learning 
hierarchy in the instructional setting of the experiment were 

74 
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obtained from the students' performances on the quizzes 

/ 

administered after each activity in the unit of instruction* 
The quizzes included problems which tested each student's 
ability to perform the intellectual shills identified in the 
learning hierarchy. Each student's performance on these quiz 
problems was the source for the validation data. The con- 
sistency# adequacy# and completeness ratios were calculated 
according to the validation procedures described by Walbesser 
(1). The value of 0.80 selected as an acceptable validation 

level for all ratios during the construction trials of the 

* 

hierarchy was used as the acceptable level for a valid hier- 
archy in the experimental set; j, The ratios are shown in 
Figure 5 on page 76. 

The data obtained during the construction of the 

hierarchy yielded ratios of 0.80 and above for all ratios 
% 

except two completeness ratios. The completeness ratios at 
cells 5A and 4B were 0.67 and 0.71# respectively. The inves- 
tigator assumed that; the longer time available for teaching 
the unit of instruction during the experiment would result 
in completeness ratios above the 0.80 level at cells 5 A and 
4B. The experiment was thus conducted with the assumption 
that the hierarchy that was used in the experiment was valid 

at the 0.80 level. The data shown in Figure 5 do not support 
this assumption. 

’ * 
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1 1 AlvNi|\!G SI QIJI NO!: 



(FINAL VALIPATl.ON ANALY'J I S 



RAVI OS) 



.85 
* .92 
1.95 





Set A: 


Set B: 


Part 1. 


(x,y) 1 y 2 lx + al , x real} 
(x,y) | y > x + b , x real} 
(x,y) | y2 c ~ x, x reeln} 


y - |x 4 a{ 
y •• x + b 
y ~ c - x 


Part 2. j 


l(x,y) | y> d, x real 

|(x*y) I xj> *• x t«oi 




Note: a, b, and c are intcgcra. 


Note.: 2 oiny be replaced by », ) ,q or ( ; 

a, b, ci d, and e Are lutegorn. 





FI'OlTpl’ q 



Leg end of 
Ratios : 

Consistency y 
Adequacy \ 
Completeness Cj 
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Other findings which relate to the learning hierarchy 
are shown in Table III, The percent of students in the 
experiment who correctly responded to specific percentages 
of the problems on the immediate posttest are displayed. 

The percentages shown in the first row of Table ill reflect 
that the posttest contained seven problems. Only 56% of the 
students in the experiment correctly worked 71% of the prob- 
lems on the immediate poettest. The posttest problems were 
designed to measure the ability of the students to perform 
the terminal task of the learning hierarchy. The data indi- 
cate that the combination of the teaching techniques used in 
the experiment and the learning hierarchy did not adequately 
enable students to perform the final task. 



TABLE III 

PERCENT OF STUDENTS WORKING PROBLEMS CORRECTLY 

ON IMMEDIATE POSTTEST 



Percent of Problems 


















Correctly Worked 


0% 


14% 


29% 


43% 


57 % 


71% 


CO 


100% 


Percent of Students 
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in Sample 


100% 


93% 


85% 


71% 


62% 


56% t 


44% 


21% 




78 



CRITERION INSTRUMENT RELIABILITY AND 
OBJECTIVES TEST RELIABILITY 

The Kuder-Richardson procedure for estimating reli- 
ability, using test-item statistics, was applied to the 
performance test scores of the sample used in the study. 

The Kuder-Richardson formula 20 measures internal consistency 
or homogeneity of the test material (2). An estimate of the 
reliability of the test under the four different treatments 
is provided by the reliability coefficients reported in Table 
IV for each of the treatment groups. 



TABLE IV 

RELIABILITY COEFFICIENTS OF THE POSTTEST 
FOR EACH TREATMENT 







Treatment Groups 




Measure 


T 

1 


*2 *3 


*4 


Kuder-Richardson 
estimated reliability 


.76 


.84 .79 


.81 

♦ 


In his discussion related 


to analysis and evaluation 


of science tests. Hedges 


provides 


an answer to the 


. 1 

question 



concerning an acceptable value for the reliability of science 
tests. Hedges (3) states, 
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Your own tests should have a reliability of about 
.60, whereas standardized test-mahers should get 
as high as .90 or more. 

He also adds. 

If you ever get as high as .67 on one of your tests, 
be grateful. 

On the basis of the criteria suggested by Hedges, 
the reliability coefficients displayed in Table IV for each 
treatment provxde sufficient evidence to support the assump- 
tion of the reliability of the posttest. 

The Kuder-Richardson formula 20 was also used to 
estimate the reliability of the objectives test scores. A 
reliability coefficient of 0.56 was obtained. The author 
considered this value sufficiently close to 0.60 to provide 
evidence to support the assumption of the reliability of the 
objectives test. 



COMPARISON OF EXPERIMENTAL 
TREATMENTS 

Statistical procedures utilized in this study to 
compare the effects on learning and retention of the four 
treatments include the treatments-by^-levels analvsis of 
variance and the repeated measures analysis. The bindings 
from these two analyses are reported in this section. The 
research hypotheses are restated preceding the null hypoth 
eses tested. After the relevant findings are reported, a 
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. statement of the appropriate statistical decision concludes 
each presentation. 

Xn cases of missing data in the comparison of the 
treatments, a decision was made to use an estimate of the 
missing scores. One student became ill during the experi- 
ment and dropped out of the study. Pour other students were 
absent for the unannounced delayed posttest. Winer stated 
in regard to the estimating of missing data; 



In cases where the number of observations within 
a particular cell is small relative to the num- 
ber of observations in other cells in the same 
row and column or adjacent rows and adjacent 
columns, the information provided by these other 
cells may be used in estimating the mean of a 
specified cell [4] . 

The mean of each cell containing the missing data was used 

as an estimate of the missing data in' the author’s study. 



Treatments -by -levels 
Analysis of Variance 

The comparative effectiveness of the four instruc- 
tional methods on student achievement was studied by treat- " 
ments-by- levels analysis of variance. The findings relative 
to achievement pertain to the first six research hypotheses. 

M§earchJ^ Giving students statements 

of the behavioral objectives (with examples) before 
each activity of an instructional unit (T ) results 
in higher achievement scores for the students so 
informed than those students who are given no infor- 
mation beyond the actual instructional unit activity 

<V* 
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This hypothesis was examined by testing the statistical null 



hypothes is : 




Where \i ^ - mean of the immediate posttest 




scores for the T r group. 



R esearch Hy p oth e sis 2 ; Giving students copies of 
the learning hierarchy with examples of sequence 
cells at the beginning and at the end of an 
instructional unit (T 0 ) results in higher achieve- 
ment scores for the students so informed than for 
those students who are not given any information 
beyond the actual instructional unit activity (T^ . 

This hypothesis was examined by testing the statistical null 

hypothesis: 



Research .Hypoth es ds 3 : Giving students statements 

of the behavioral objectives (with examples) and 
copies of the learning sequence before each activity 
of an instructional unit (T ) results in higher 
achievement scores for the students so informed than 
for those who are not given any information beyond 
the actual instructional unit activity (T ),, 

This hypothesis was examined by testing the statistical null 



2 

H : u 

o 




mean of the immediate posttest 
Scores for the T arnup, 

posttest 

scores for the T 3 group. 




ERIC 



hypothesis; 



82 



H o 3s **4 ***1- 

Where ~ wean of the immediate posttest 
scores for the T- group, 

**4 - mean of the immediate posttest 
scores for the group* 

• * 

Research Hypothesis 4 : Giving students statements 

of the behavioral objectives (with examples) and 
copies of the learning hierarchy before each activity 
of an instructional unit (T^) results in higher 
achievement scores for students so informed than 
for students who are given only statements of the 
behavioral objectives (with examples) before each 
activity Of an instructional unit (T^). 

This hypothesis was examined by testing the statistical null 

hypothesis: 

H c 4 : 

* 

Where = mean of the immediate posttest 
©c6res for the T group, 
fj ~ mean of the immediate posttest 
scores for the group. 



Research Hypothesis 5 : Giving students statements 

of the behavioral objectives (with examples) and 
the learning hierarchy before each activity of an 
instructional unit (T . ) results in higher achieve- 
ment scores for students so informed than for stu- 
dents who are given only copies of the learning 
hierarchy with examples of sequence cells at the 
beginning and at the end of an instructional unit 

<V- 



This hypothesis was examined by testing the statistical null 
hypothesis: 
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Where - mean of the immediate posttest 
scores for the T group, 

- mean of the immediate posttest 
scores for the group. 



The differences in achieve- 
ment scores resulting from the four treatments are 
not identically reflected at each ability level. 



This hypothesis was examined by testing the statistical null 



hypothesis: 

6 

H 0 = 0 - k = 0, for all j3c 

Where 0 = the interaction of, the j th level of 

3 ability and the b> treatment. 



A treatments-by-levels analysis of variance (T x L 
ANOVA) was employed to test each, of the above six null 
hypotheses. The procedure for testing the first five null 
hypotheses included two steps: 

1) Using T x L ANOVA, determine whether the data 
supported or rejected the null hypothesis; 

M 1 * ^2 = ^3 “ ** 4 * 

2) If the null hypothesis <« <= ft , = ft , = p, .) was 
rejected, by using the TuKey-b method, determine 
which of the first five null hypotheses were 
rejected by the data. 



A summary of the results of the treatments-by-levels 
analysis of variance of immediate posttest scores appears in 
Table V. The F ratio observed for treatment 



effect was 0.563. 
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, TABLE V 

TREATMENTS -BY-LEVELS ANALYSIS OF VARIANCE 
OF IMMEDIATE POSTTEST SCORES 



Source of 
Variation 


df 


Mean 

Square 


F 


Critical 
Value of F 
at * 05 Level 


Levels of 
Ability 


2 


6,503.54 






Treatments 


3 


282 ♦ 09 


.56 ns 


2.78 

(3,76 df} 


Interaction 
(Treatments x 
Levels) 


6 


93 . 28 


. 19 ns 


2.27 

(6,76 df) 


Within Cells 

( TPir* \ 

\-M.U 4. VA. / 


76 


501.10 







The critical value of F at 3,76 df and 0,05 level of signifi- 
cance is 2*78 . Therefore, the over-all null hypothesis 

V = H m H = ^4 

was retained. Since the over-all null hypothesis was retained, 
obviously no differences would be detected between pairs of 
sample means. Hence, each of the first five null hypotheses 

H o 1; H s 

H 2 : u < n, 

o p 3 ~ P 1 

H o 4; **4 S ^2 
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__ 5 

H o 1 "4^3. 

was retained. No data were analyzed using the Tukey-b method. 

The F ratio observed for ability -by -treatment inter- 
action effect was 0.19 . The critical value of F at 6,76 df 
and 0.05 level of significance is 2.27 . Therefore, the 
null hypothesis 

H : 8.. » 0, for all jk 

o jk J 

was retained. 

The standard deviations and the cell and marginal 

means of the four treatment groups on the immediate posttest 

are reported in Table VI. The F test was used to test 

max 

the degree of homogeneity of the sample variances of the 

achievement scores. The F observed was 116.93 and the 

max 

F critical was 8*85 at the 0.05 level of significance, 
max 

This finding challenges the appropriateness of the T x L 
ANOVA statistical design for the author's study. Support 
for the appropriateness of the design is provided by the 
classical Norton (5) study of the effects of heterogeneity 
of variance. Norton found that the analysis of variance 
test was robust with regard to violations of the homogeneity 
of variance assumption. Ferguson (6), also, argued for the 
robustness of the ANOVA test to departures from the homoge- 
neity assumption. 
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Repeated Measures Analysis 

The effectiveness of the four instructional methods 
on student over-all performance and rate of forgetting was 
studied using a repeated measures analysis. The findings 
relative to over-all performance and rate of forgetting per- 
tain to the last three research hypotheses. 

Research Hypothesis 7 ; The four treatments have 
differential effects on the over-all performance 
of students. 

This hypothesis was examined by testing the statistical null 
hypothesis: 

H 1 % ql *= 0, for all k 

i a (Mw 

th 

•f. Where o L « the effect of being in the k 

treatment group 

Research Hypothesis 8 : The four treatments result 

in different rates of forgetting, 

*rihis hypothesis was examined by besting the statistical null 

f 

hypothesis: 



8 

H 2 
o 


«y i3c = 


0, for all 


ik 


Where 


ay , - - 
' xk 


the interar 
and the k 


tlri 

rtion of the i posttest 

treatment 



Research Hypothesis 9 ; The differences in over-all 
performance scores resulting from the four treatments 
are not identically reflected at each ability level. 

This research hypothesis was examined by testing the statisti- 
cal null hypothesis: 



o 
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H c 9 * ** °* for 3^ 

til 

Where /Sy., » the interaction of the j level 
^ of ability and the k treatment* 



A repeated measures analysis was used to test each 
of the above three hypotheses. The procedures for testing 



the eighth null hypothesis included the following two steps: 

1) Using the repeated measures analysis, determine 
whether the data supported or rejected the null 
hypothesis: ay ~ 0, for all ik . 



2) 



If the null hypothesis (ay.- 
was rejected, determine which 



* 0, for all ik) 
treatments 



resulted in the least rate of forgetting by 
plotting the slopes of the retention curves. 



Similarly, the procedure for testing the ninth null hypothe- 
sis included these two steps: 



4 

1 



1) Using the repeated measures analysis, determine 
whether the data supported or rejected the null 
hypothesis: $y “ 0, for all jk , 



2) If the null hypothesis (£y . « 0, for all jk) 

was rejected, plot the interaction profiles 
consisting of graphically depicted data showing 
changes in over -all performance scores across 
treatment methods separated by ability levels. 



A summary of the results of the repeated measures 

analysis of immediate and delayed posttests scores is shown 

*■ ♦ 

in Table VII. The F ratio observed for treatment effect was 
0.37 . The critical value of F at 3,76 df and 0.05 level of 
significance is 2,73 . Hence, the null hypothesis 
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7 

H ' : 0^. = 0, .for all k 

was retained. Hie F ratio observed for treatment ~by~posttest 
interaction effect was 2.50 . Since the critical value of F 
at 6,76 df and 0.05 level of significance is 2.23 , the null 
hypothesis 



H 8 :: ay., = 0, for ik 

o 'ik 



was rejected. The fact that there was a statistically sig- 
nificant treatment -by -posttests interaction indicated that 
the slopes of the retention curves for the treatment groups 
were different. In order to determine which treatments 
resulted in the least rate of forgetting, the slopes of the 



retention curves were plotted as shown in Figure 5 based 
upon the data in Table VIII. The retention curve of treat- 
ment T^ had a slope which approached a value of zero, while 
the retention curve of treatment had a positive slope. 



TABLE VIII 



TREATMENT MEANS FOR POSTTESTS 



• 


Immediate 


Delayed 


Treatment ^ 


76.50 


72.95 


Treatment T 2 


69.55 


73.50 


Treatment T^ 


73.09 


70.50 


Treatment T. 

4 


77.50 


76.80 



T 

Immediate 



Posttests 



FIGURE 6 



Delayed 



i 



RETENTION CURVES 
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The F ratio observed for level-by-treatment effect 
was 2.50 . The critical value of F at 6,76 df and 0.05 
level of significance is 2.23 . Therefore, the null 
hypothesis 

y. 

H o 9 '- Pv ik = °* f ° r jk 

was rejected. The level-by-treatment interaction profiles 
are shown in Figure 6. The profiles are based upon the data 
in Table IX. The mean of the middle ability students in 
treatment T was 87.14 , while the mean across all four 
treatments was 81.01 . The means of the other two ability 
groups in treatment T^ did not show as much difference 
between their respective means and their means across the 
four treatments. 



TABLE IX 

ABILITY LEVEL OVER-ALL PERFORMANCE MEANS 

. FOR TREATMENTS 



Ability 

Levels 


* 


Treatments 




T 

1 


T 2 


T 3 


T. 

4 


High 


94.25 


86.75 

f 


94.50 


94.00 


Medium 


82.11 


81.44 


73.33 


37 . 17 


Low 


58.67 


54.83 


60.00 


59.66 



ERLC 
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FIGURE 7 

LEVEL X TREATMENT INTERACTION PROFILES 



► 
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Table X presents the standard deviation and the cell 
and marginal means for the immediate posttest and the delayed 
posttest scores analyzed in the repeated measures analysis. 

An analysis of the display of standard deviations in Table 
VI reveals a noticeable heterogeneity of variances. The 
discussion on page 85 concerning the robustness of the analy- 
sis of variance in regard to the assumption of homogeneity 
of variances applies in this case, also. 

POST-HOC ANALYSES 

0 

The findings obtained from both planned and unplanned 
post-hoc analyses are reported in this section. The planned 
post-hoc analysis consisted of an analysis of the objective 
test scores while the unplanned post-hoc analysis involved 
an analysis of the data to determine percentages of students 

v 

in each treatment who correctly responded to the same number* 
of problems on the performance test. 

* 

Planned Post-hoc Analysi s 

Students in this study were given statements of the 
behavioral objectives with and without copies of the learning 

; ’ t 

hierarchy to enable them to be aware of the objectives of the 
activities in which they were engaged. An analysis of data 
obtained from the objective test portion of the quizzes 



TABLE X 



MEANS, CELL SIZES, AND STANDARD DEVIATIONS 
OF IMMEDIATE AND DELAYED POSTTEST SCORES 



Treat- 



Levels 

of 



Posttests 




t 



t 
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TABLE X (continued) 



Levels Posttests 

Treat- of .>■ 

inents Ability Xitirnecixate Delayed 
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t which were administered after completion of each activity) 
was made to determine the correlation between the students 1 
awareness of the objectives and their achievement test scores. 
Students in treatments T^, t^> and T were graded on the 
number of problems on the quizzes that they correctly 

identified as examples of the objectives of the activities. 

Ihe students were then classified into four categories 

® 2 ' ° 3 * according to their grades on the objectives 

test* The score means in the four classifications and the 

number of students in each classification are shown in Table 

XI. There was a total of 66 students in treatments T , T , 

2 3 

and T 4 . The objectives test scores of eight of the 66 stu- 
dents were not included in the data displayed in Table XI 
because the eight, students were inadvertently administered 
one quiz designed for the students in treatment group T_ , 

1 TABLE XI 

OBJECTIVES TEST CLASSIFICATIONS-- 
MEANS, NUMBER OF STUDENTS 

Classifications 




(0-25 pts) 




(26-50 pts) 




(51-75 pts) 




(76-100 pts) 



Means 10,00 

No. of 

students 7 



40,00 



63.75 



92.00 



8 



8 



35 
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A comparison of the means of the objectives test scores and 
the corresponding achievement test scores and over-all per- 
formance scores of the students in each of the four objectives 
classifications is shown in Table XXX * Two Pearson product- 
movement correlation coefficients were calculated. The 
correlation coefficient measuring the degree of linear asso- 



ciation between the students’ 



awareness of the objectives 

i 



and their performance on the achievement test was found to be ' 
0,11 * The correlation coefficient which sneasrxred the degree 
of linear relation between the students’ awareness of the 
objectives and their over-all performance was found to be 0,40, 
The findings reveal that the students* awareness of the objec- 
tives w m uncorrelated with achievement test scores and also 
was uncorrelated -with the students* over-all performance. 



TABLE XXX 



COMPARISON OF MEANS — OBJECTIVES TEST, ACHIEVEMENT TEST, 

AM) OVER-ALL PERFORMANCE' 



Class if icat ion 


Objectives 

Test 

Means 


Ach ievement 
Test 
Means 


Over -all 
Performance 
Means' 


°i 


10.00 


69.43 


139.43 


°2 


40.00 


64.00 


130.75 


0, 


63.75 


60.50 


120.83 
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* 



Different procedures were used to inform the stu~ 

dents in the three treatments, 2» , It , and T . , of the 

2 3 '4 

behavioral objectives. These procedures are described in 
Chapters IX and XIX. From the nature of the three procedures, 
the author expected the three treatments to have differential 
effects on the students* awareness of the objective , The 
analysis of variance statistical design was utilised t<p test 

the following null hypothesis; 

* * * 

V H “^4 

* 

Where ** the mean of students’ objectives- 

test ©cores in treatment 

it 

« the mean of students’ objectives 
test scores in treatment T~, 

* 

** the mean of students* objectives 
test score© in treatment T. . 



Table XXIX presents the si&e, means, variances, and 



standard deviations of the three treatment groups on the 

objectives test. One student* s score was randomly selected 

for deletion from treatment in order t 6 obtain equal cell 

si&es. Whereas the mean of treatment lb was 48.5 , treatment 

•i 

scored an average of 85,4 points out of 100 points, 

Table XXV presents the summary table for the analysis 



o 



of variance. The F ratio observed for treatment effect was 
10,66 while the F critical for 2 , 55 degrees of freedom was 
5.79 at the 0.005 level of significance. Therefore, the 
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' TABLE XX I 1 

* 



SIZE, MEANS, VARIANCES t AND STANDARD DEVIATIONS 



OF THE THREE TREATMENT GROUPS (T 
OH THE OBJECTIVES TEST 



«•% if 
& 



V 



V 



Treatment© 


n 


Mean 


Variance 


Standard 

Deviation 


T 

2 


IS 


80.0 


533.33 


23.1 


A - 


19 


^4*8 * 5 


9X4.22 


3p.2 


T 4 


19 


85.4 


650.22 


25.5 



TABLE XIV 



TREATMENTS -BY-LEVELS M&LYS I S 
OF OBJECTIVES TEST SCORES 



Source of Mean F c at 

•'Variation d£ Square F .005 Level 



Treatments 



7,302,5 



10*06* 



5.79 



Error 



5 



726.0 



Total 57 8,028.5 




*p < .005 
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null hypothesis 

* * * 

H : ** u„ 

O P 2 ^4 

was rejected. The Tukey~b method was applied to locate dif- 
ferences between means, The following finding were obtained 

at 0,05 level of significances * 

* * 

H > h 

■k * t 

»2 = ^4 

* it 

> **3 



Since there is no randomisation involved in this quasi- 

# 



experimental analysis, the author cannot make a rigorous 
statement concerning significant differences « However# the 
comparisons provided an indication of the effect the three 
treatments had on the students’ awareness of the objectives - 
To test for homogeneity of variances# the ^ max test 
' was used. The following null hypothesis was tested; 







2 



The F observed was 1.71 and the F critical was 2.21 at 
max 

the 0,05 level of significance. Thus, the null hypothesis 

was retained and the assumption of homogeneity of variances 

* 

i 

was supported by the data. 



il ERIC 
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Other Post -hoc Analyses 

The findings shown in Table XV show the percentage 
of students in each treatment who correctly worked specific 
numbers of problems on the achievement teat* Only 10% of 
the students in treatment T„ worked all .seven of the prob~ 



lems correctly r while 32% of the students in treatment T 
worked a 3,1 seven of the problems correct ly* 



4 



TABLE XV 

PERCENTAGE OF STUDENTS WORKING PROBLEMS 
ON ACHIEVEMENT TEST ' 





Nujnb 


■er of 


Pr ob 1 eras Cor r ec t ly 


Worked 


— r . ... . - 


0 


1 


2 


3 4 


5 


6 


7 


T, , cvxmx 1 at i ye 
^percentage of 
students 


100 


95 


so 


76 66 


57 


47 


xq 


T^, cumulative 
'^percentage of 
students 

* 


ibo 


86 


82 


59 50 


45 


36 


14 


. f cumu X at i ve 
^percentage of 
students 


100 


91 


86 


Uf^-itjfjr^ Je, | i *i , JJ.~|ij ,J i (I 

73 64 


64 


41 


27 


, cumulative 
percentage of 
students 


100 


100 


J*V ^ 

PC 


77 68 


59 

fi 


50 


32 
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SUMMARY OF FINDINGS 

h comparison of the four treatment means of the imme- 
diate posttests scores detected no significant difference at 
the 0,05 level of significance, &lso, an analysis of the 
immediate achievement scores did not yield a significant 



interaction effect between levels of ability and treatments 



significant differences were found between the 



over-all performance means of the four treatments. However, 



analysis of the over-all performance df3.t& detected a sig- 
nificant levels -by -treatment interaction. In addition, a 
significant difference in rate of forgetting resulting from 



the four treatments was observed, ttfhile the slopes of treat- 



ments and retention curves had negative gains and the 
slope of the retention curve of treatment T approached zero, 

the slope of the treatment T.. retention curve was found to 

X 

have a positive gain. 



tfhe means of the objectives test means of treatments 
and T. were each observed to be significantly greater than 
the objectives test, mean resulting from treatment *^ <a 

percentages of students in treatments and who worked 
all seven of the problems on the achievement test correct ly 



were 10 percent and 32 percent, respectively. 



i 
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CHAPTER V 



SUMMARY, CONCLUSIONS, AND IMPLICATIONS 

' I 

In this chapter the study is suirartar conclusions 

are outlined and discussed, and certain imp. ica ions are 
suggested* In addition to the consideration of the conclu- 
sions, the validity of the study is considered in the dis- 
cussion. The .implications considered in the final portion 
of the chapter are derived from the findings of this study 

and pertain to both current practice and future research. 

t 

SUMMARY 

This study was conducted to investigate the question: 

•h ^ a group of students is informed of the behavioral 
objectives and the learning hierarchy of a unit of 
instruction and another group of students receiving 
the same unit of instruction is not so informed, will 
there be differences in effect on learning and reten- 
tion? 



It was expected that those students who are informed of the 
behavioral objectives of an activity will perform higher on 

< i 

achievement and retention posttests than those students who 
are not so informed. Moreover, it was expected that students 
who are informed of the activity’s place in a hierarchical 
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learning sequence (designed after Robert Gagne’s cumulative 
learning model) in addition to being informed of tbe 
behavioral objectives of the activity will perform higher 
on achievement and retention posttests than those who are 
informed just of the beheivioral objectives of the activity. 
The author's research was designed to determine whether for 
a specific population with specific treatments data could be 
obtained to support the above expectations. According ly, 
eighty-eight elementary education majors in a four-year col- 
lege were blocked on ability levels and randomly assigned to 
four treatments* While receiving different information about 
the behavioral objectives and the hierarchical learning 
sequence, all four groups received the same set of self- 
instructional text material covering a mathematical unit of 
instruction* The following research hypotheses,, associated 
with the initial question and reflecting the stated expecta- 
tions, were tested by the experiment : 

Research Hypothesis 1 ; Giving students statements 
of the behavioral objectives (with examples) before 
each activity of an instructional unit (T^ ) results 
in higher achievement scores for the students so 
informed than those students who are given no infor- 
mation beyond the actual instructional unit activity 

<V- 



Research Hypothesis 2 : Giving students copies of the 
learning hierarchy with examples of sequence cells at 
the beginning and at the end of an instructional unit 
(T^) results in higher achievement scores for: the 
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students so informed than for those students who are 
not given any information beyond the actual instruc- 
tional unit activity (T^) * 



Research Hypothesis 3 : Giving students statements of 

the behavioral objectives (with examples) and copies 
of the learning sequence before each activity of an 
instructional unit (T^) results in higher achievement 
scores for the students so informed than for those 
who are not given any information beyond the actual 
instructional unit activity (T^) • 

I 

Research Hypothesis 4 : Giving students statements of 

the behavioral objectives (with examples) and copies 
of the learning hierarchy before each activity of an 
instructional unit (T ) results in higher achievement 
scores for students so informed than for students who 
are given only statements of the behavioral objectives 
(with examples) before each activity of an instruc- 
tional unit (T^). 



/ 

Research Hypothesis 5 : Giving students statements of 

the behavioral objectives (with examp3.es) and the 
learning hierarchy before each activity 6£ an instruc- 
tional unit (T^) results in higher achievement scores 
for students so informed than for students who are 
given only copies of the learning hierarchy with 
examples of sequence cells at the beginning and at 

the end of an instructional unit (T„). 

3 



Research Hypothesis 6 : The differences in achievement 

scores resulting from tine four treatments are not 
identically reflected at each ability level. 



Research Hypothesis 7 : The four treatments have dif- 

ferential effects on the over-all performance of 
students » 



Research Hypothesis 8 : The four treatments result 

in different rates of forgetting. 
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fie sear ch Hypoth e s i s 9 : The differences in over-all 

performance scores resulting from the four treatments 
are not identically reflected at each ability level. 

The subjects were students enrolled in four sections 
of the second semester of a two-semester sequence mathemat- 
ics course for elementary education majors at Towson State 
College, Baltimore, Maryland in the spring of 1969. The 
students were classified according to their ability levels 
as reflected by their grades in the first semester of the 
two-semester sequence course before being randomly assigned 
to the following four treatments: 

^i — self-instructional text material on a mathe- 
matical unit. 

— self-instructional text material on a mathe- 
matical unit with the objectives given before 
each activity in the unit. 

Tg— self-instructional text material on a mathe- 
matical unit with students informed of the 
learning hierarchy at the beginning and at 
the end of the unit. 

T 4 — self-instructional text material on a mathe- 
matical unit with students informed: 

(a) at the beginning of the unit of the 
learning hierarchy for the instructional 
unit, and 

(b) at the beginning of each activity of the 
objectives of that activity and of that 
activity’s place in the hierarchical 
learning sequence. 

The self-instructional material for the instructional 
unit, based upon the learning hierarchy constructed for this 
study and consisting of eight activities, was administered by the 
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exper imentor for eight consecutive class days. After the 
.completion of the instructional unit, posttests were adminis- 
tered immediately to compare the degree of learning, and, 
after two weeks, to compare the amount of retention. 

Through treatments-by-levels analysis of variance, 
the relative effectiveness of the four treatments on student 
achievement as measured by the immediate posttest was deter- 
mined. Differential effects of the four treatments on learn- 
ing the intellectual skill of the terminal task of the 
learning hierarchy were not significant at the 0,05 level. 

The treatments-by-levels interaction effects of the four 
treatments were also found not significant at the 0.05 level. 

At a 0,05 level of significance, a repeated measures 
analysis detected no differential effects, resulting from 
the four treatments, on student over-all performance. How- 
ever, the four treatments resulted in significantly different 
rates of forgetting. The group of students who were given 

s 

statements of each activity’s objective showed a positive 
gain in performance over time. In addition, the differences 
in the over-all performance scores resulting from the four 
treatments were not identically reflected at each ability 



level. 
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CONCLUSIONS 

TLe conclusions based upon the findings yielded by 
statistical treatment of the data are presented below. Each 
conclusion is stated in terms of the relevant research 
hypothesis. 

1. The hypothesis that giving students statements of 
the behavioral objectives (with examples) before each activity 
of an instructional unit results in higher achievement scores 
for the students so informed than those students who are 
given no information beyond the actual instructional unit 
activity is not supported by the data. 

2. The hypothesis that giving students copies of 
the learning hierarchy with examples of sequence cells at 
the beginning and at the end of an instructional unit results 
in higher achievement scores for the students so informed 
than for those students who are not given any information 
beyond the actual instructional unit activity is not sup— 
ported by the data. 

3. The hypothesis that giving students statements 

i 

of the behavioral objectives (with examples) and copies of 
the learning sequence before each activity of an instruc- 
tional unit results in higher achievement scores for the 
students so informed than for those who are not given any 
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information beyond the actual instructional unit activity is 
not supported by the data. 

4. Ine hypothesis that giving students statements 
of the behavioral objectives (with examples) and cox^ies of 
the learning hierarchy before each activity of an instruc- 
tion unit results in higher achievement scores for students 
so informed than for students who are given only statements 
of the behavioral objectives (with examples) before each 

activity of an instructional unit is not supported by the 
data. 

5. The hypothesis that giving students statements 
of the behavioral objectives (with examples) and the learn- 
ing hierarchy before each activity of an instructional unit 
results in higher achievement scores for students so informed 
than for students who are given only copies of the learning 
hierarchy with examples of sequence cells at the beginning 

and at the end of an instructional unit is not supported by 
the data. 

6. The hypothesis that the differences in achieve- 
ment scores resulting from the four treatments are not 

identically reflected at each ability level is not supported 
by the data. 

7. The hypothesis that the four treatments have 
differential effects on the over-all performance of students 
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is not supported by the data. 

8* The hypothesis that the four treatments result 
'in different rates of forgetting is supported by the data. 

9. The hypothesis that the differences in over-all 
performance scores resulting from the four treatments are 
not identically reflected at each ability level is supported 
by the data. 

r 

DISCUSSION 

The conclusions of this study may be conveniently 
partitioned into two areas: 

1) The effects of the treatments on immediate 
achievement scores obtained on an immediate 
posttest, and 

2 ) The effects of the treatments on over-all 
performance scores and rate of forgetting as 
measured by an immediate posttest and a delayed 
posttest. 

This section will discuss the conclusions of this study in 

the perspective of these two separate areas. 

* ' ► 

Immediate Achievement 

The results of the study appear to be quite conclu- 
sive in terms of there being no observable differential 
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effects bf the four treatments on immediate achievement 
scores. The analysis of the data provided no support for 

qualifying :this finding on the basis of ability levels. 

*. ■ * 

There are several possible reasons that these results were 
obtained: 

r 

1) Complexity of study. The unfamiliar format of 
additional instructions concerning the behavioral objectives 
and the learning hierarchy may have been a confounding fac- 
tor in the study. The degree of unfamiliarity with the over- 
all format was exemplified on a few occasions in the beginning 
of the study when students who had received examples of all 
the subtasks in the hierarchy were observed trying to work 
them rather than note the solutions provided. The level of 
complexity may have been heightened by those students whose 
reading abilities were not adequate for the material. 

2 * gormat of instruction. The fact that the instruc- 

* * • ‘ . • * 

tional format was self -instructional in a single medium may 
have been a confounding factor. One might question whether 
a similar study conducted in a typical classroom situation 
without the use of self-instructional materials would yield 
data that would reflect differential effects of the four 
treatments on immediate achievement scores. 

3) Admi nistratio n procedures . Another factor which 

t . , * 

may have affected the results of this study is the procedure 
use^ to administer the treatments* The author administered 
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the four treatments within each of four classroom. The 
individual booklet containing each activity was assumed to 
sufficiently insulate each student from the other three 
treatments. However, the fact that the students were aware 
that they were receiving four different sets of instructional 
materials may have sufficiently aroused their curiosity to 
lead to the sharing of information outside of the classroom. 
The investigator became aware of one situation where stu- 
dents were sharing notes outside of class. 

4) Validity of the learning hierarchy . The validity 

of the hierarchy is reflected by the range of the final 

* * • 

validation analysis ratios (.66 to 1.00) shown in Figure 5, 
page 76. Although a few of the ratios did not meet the 
criteria selected by the author, the range of the validation 
ratios indicates that the hierarchy has considerable 
Validity. 

Over-all Performance and 
Rate of Forgetting 

The results of the study indicate that if the levels 
of ability of students are not considered, then the benefits 
in terms of over-all performance to be derived from either 
of the four treatments do not differ significantly at the 
0.05 level. However, the presence of the significant treat- 
ments -by -levels interaction effect found in the study indicate 








that differences between the effects of the four treatments 
do exist within the three levels of ability. Therefore, any 
predictive statement concerning the effects of the four 
treatments on over-all performance must be qualified by 
specifying the levels of ability involved. 

The observed treatments-by~levels profiles reveal 
that giving students statements of the behavioral objectives 
of an activity accompanied by a copy of the learning hier- 
archy is more beneficial (when compared to the other three 
treatments) to the students in the middle ability level than 
to those students in either the high or the low ability 
levels. It is reasonable to argue from this finding that the 
low ability level students were not able to assimilate the 
additional information and, thus, received no benefit from 
being given the objectives and/or the learning hierarchy. 
From the treatments -by- levels profiles, one might project 
that the additional information about objectives actually 

confused the low ability level students. The /students in 

/ 

the high ability level group apparently received no differ- 

' / 

ential benefit from either of the treatments. One might 
argue in this case that the pre-organizing benefit possibly 
provided by the statements of the behavioral objectives 
and/or learning hierarchy were not needed. Perhaps the high 
level students were able to infer the objectives and the 
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learning sequence itself. lu the case of the middle ability 
group# one could assert that the objective statements accom- 
panied by the learning hierarchy enabled them to gain a 
helpful perspective about the mathematical skill Which they 
were expected to learn. 

The significant treatment -by -posttest interaction 
effects found by the repeated measure analysis is a second 
indication that differences in the four treatments do exist. 
This interaction effect reveals that the treatments result 
in different rates of forgetting. The more striking differ- 
ence observed is that while the rate of forgetting of treat- 
ments T^ and T show a negative gain and the rate of forgetting 
Qf treatment T^ shows neither gain nor loss of the mathemat- 
ical skill, the slope of the treatment retention curve 
shows a positive gain. The findings of this study reveal 
that while giving students statements of the behavioral 
objectives of each activity of the instructional unit did 
not result in a relatively high immediate achievement scores, 

the treatment did result in greater resistance to forgetting 

» \ 

than the other methods of instruction. One could reasonably 
argue that the students in treatment T were able to gain in 
ability to perform the terminal task because the combination 
of being aware of the behavioral objectives and the two-week 
period between posttests resulted in their being able to 
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better assimilate the instructional material they had 
received. 

VALIDITY OP THE STUDY 

Two general criteria of a well-planned research 
design were considered by the investigator: internal and 

external validity. Consideration is given in this section 
to the precautions taken in this study to control extraneous 

variables and the generalizability of the findings is dis- 
cussed. 

Internal Validity 

The design of the study included the following list 

of precautions which were taken to assure that any possible 

treatment differences were indeed the result of treatment 
conditions . 

Concurrent events. All students in the study 
were enrolled in Math 205 at Towson State college. The full 
time teachers of each of the four sections of Math 205 used 
m thxs study had followed the same syllabus for the course. 
No portion of the mathematics topic chosen for this study 
had been taught in Math 205 prior to the time of the study. 
The students in the available population were enrolled in 
only one mathematics course. The full time teachers did not 
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teach any topic during the two-week period between immediate 
and delayed posttests that required the mathematical skills 
learned during the experiment as a foundation. In addition, 
the full time teachers did not conduct a review of the 
mathematics skills learned during the exx^eriment. Hence, 
it was felt that the events occurring before the experiment, 
during the three -week instructional period, and during the 
two-week period between the t ao posttests were sufficiently 
controlled for the purposes of the study. 

2. Maturatio n. The effects of maturation refer to 
general processes operating within individuals as a result 
of passage of time, including growing older, growing hun- 
grier, or becoming more fatigued. Although there was some 
time pressure accompanying the learning experiences, any 
change in productivity due to fatigue or pressure was spread 
evenly over the four groups. The fact that the students 
were randomly assigned to treatments also reduced the pos- 
sible threat due to maturation. Because slow students were 
allowed to attend additional class sessions, it is considered 
unlikely that time had any influence on the results of the 
experiment. 

3. Testing. The same test was used for the delayed 
posttest as was used for the immediate posttest. The exis- 
temee of a carry-over effect is a possibility. In order to 
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reduce the possibility of such an effect, each student 
received a different version of the performance test for 
the delayed posetest than he received for the immediate 
posttest. Since the three versions of the performance test 
consisted only of three different orders in which the prob- 
lems were listed, this precautionary step against the carry- 
over effect may not have been sufficient. 

4 * Crite ria, instrumentation . Any bias or subjec- 
tivity in scoring the posttests was eliminated by the 
objective nature of the tests themselves, for which a single 
scoring key was used for both immediate and delayed posttest. 
Grading of the posttests was done by grading the same prob- 
lem for all eighty-eight students before grading the next 
problem. Thus, any possible subjectivity in grading was 
greatly reduced. Reliability of the performance test under 
each treatment was determined «nd considered very adequate. 
Therefore, any effects due to criteria instrumentation do 
not pose a significant threat to validity. 

5 * ejection. Since students were randomly assigned, 
after being blocked according to ability levels, to treatment 
groups and all students were enrolled in the same course, 
differential effects resulting from selection were felt to 
be absent. 

6 - l>gperimenta l mortality . One student in the low 
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ability group assigned to the control group withdrew from 
the course before completion of the experiment. Four other 
students were absent from class the day the unannounced 
delayed posttest was administered. Thus, one score on the 
inomediate posttest and five scores on the delayed posttest 
were lost. Since the percentage of lost scores was very 
small, it was considered adequate to substitute the mean of 

i 

the cell of the missing data for the missing score. It was 
not felt that any influence due to this mortality was suf- 
ficient to mask treatment effects. 

Chance . The possibility that the findings 
reflected chance rather than true effects was minimized by 
selection of the 0,05 level of significance. The possibility 
of reflecting chance was further reduced by the decision to 
use the experiment as the base of a ~ 0.05 . 

8 * Me Pen de nt treatments . One serious challenge 

to the findings of this study is that the students may not 
have been independent of the different treatment materials 
being used in the same classroom. Since the students knew 
they were using four different sets of material, it is highly 
likely that they discussed the differences outside of class. 
Ihe curious student could easily have become aware of the 
learning sequence and the terminal task from inquiring 
outside of class of a friend who had received a copy of the 
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learning hierarchy in his treatment materials. As a pre- 
caution of any materials leaving the classroom, each student 
was checked off a class list as he returned his material at 
the end of class. However, the possibility of the treatments 
not being independent remains the most outstanding threat to 
this study. 

External Validity 

The target population of this study consisted of the 
set of all elementary education college students who enroll 
in J:he second semester of a two-semester sequence of college 
mathematics courses designed to teach the content material 
required for elementary school teachers. The available popu- 
lation was a subset of the target po£:>ulation. The sample 
was in like manner a subset of the available population. 
Hence, the results of this experiment can be generalized 
to the target population. Replication of the experiment in 
other target population is needed to increase the generaliza- 
tion of the findings. The fact that the students in the 
study appeared to be highly motivated may have been a threat 
to the findings and to generalization to the target popula- 
tion. However, the level of motivation, if it did exist, 
seemed generally distributed among the students in the study 
and, hence, may not be a true threat to the external validity 
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of the study. 
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IMPLICATIONS 

The implication derived from the findings of this 

* 

study pertain to current practice and future research. 

Implications for 
Current Practice 

i 

1. The findings of this study lend no support to 
the assertion that telling students the behavioral objec- 
tives and/or the learning hierarchy of a unit of instruction 
will increase their performance, on immediate achievement 
tests . 

2. The stating of behavioral objectives in textbook 
format without explanations by the teacher do not signifi- 
cantly help the student to perform higher on an immediate 
achievement test. There is some basis to believe that such 
information may even confuse the student. 

3. The procedure of informing the student of the 
behavioral objective may be an effective method for pro- 
viding resistance to forgetting of learned skills. 

4. For the student of middle ability level, being 
informed of behavioral objectives and the learning hierarchy 
seems to be a beneficial method for improving his over-all 
performance. 
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Implications for 
‘ Future Research 

The results of this study have the following implica 
tions for research involving behavioral objectives and 
learning hierarchies. , .? • • 

'' f . . , . 

li The use of self-instructional materials should 
be discouraged as a. means for removing the teacher factor 

• • ’ # v*. • 

from future experiments. • . 1 

2. Future studies might more effectively be con- 

ducted if the possibility of sharing of. treatments outside 
of class were minimized. • : 

3. ^Studies should be conducted, in' a typical class- 
room situation without the use of programmed materials. 

, 4. Studies should be conducted in other academic 

■ * » / \ , * 

areas and in other academic levels (elementary, secondary, 
and college) . 

, i • 

■' Future experiments should consider the use of 

ability levels as a blocking factor. 

6. The findings indicate' that more long-term 
studies should be conducted with -perhaps' more than two 
posttests . . ; 
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USE TO BE MADE OP FINDINGS 



1. The findings of this study will be presented in a pre- 
conference seminar at the 25th annual conference of the 
Association for Supervision and Curriculum Development in 
San Francisco, California on March 12-13, 1970. The seminar 
is entitled Systems Analysis and Curriculum Development. 

The author will be a member of a team from the University of 
Maryland Baltimore County who will plan and conduct the 
seminar . 

2« The author, in conjunction with Dr. Henry Walbesser and 
others, has submitted an application to the American Educa- 
tional Research Association to conduct a symposium at the 
1970 Annual Meeting of AERA .in Minneapolis, Minnesota, 

March 2-6, 1970. The findings of this study will be dis- 
cussed in the symposium as well as the findings of other 
recent research on the use of behavioral objectives in 
teaching. 

3. The findings of this research conducted with college 
students will provide the basis for an extension of the 
study to high school students without the use of programmed 
materials. 

4. An article discussing the findings has been accepted for 
publication in the 1969 Fall issue of the journal for the 
Maryland Association for Supervision and Curriculum Develop- 
ment. 

5. A more detailed article, providing tables and graphs of 
data is under draft. This article will be submitted for 
publication in Educational Leadership, the journal of the 
national organization of the Association for Supervision and 
Curriculum Development. 

6. The findings are also being used by the 5'ithor in the 
training of in-service teachers • 
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APPENDIX A 

INTRODUCTION AND TEXT MATERIAL 
(CONTROL TREATMENT T^) 
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INTRODUCTION 



The materials for your next unit of instruction were 
written by the University of Maryland Mathematics Project, 
Perhaps you will find that the format of the materials will 
differ from the textbooks that you have previously used. 
Ordinary textbooks usually require homework. Homework is 
not required for this material. In this material# all your 
work will be done individually in class. You will be asked 
to answer questions by writing on the blanks provided 
throughout the materials or by performing the other tasks 
requested. 

These materials are designed around what, y&i l &£* 
you work on each task at the point it is called for, you 
will find that the materials have a completeness about them 
that is not in an ordinary textbook. You will also find 
that your response at each step will help you to acquire the 
skills upon which you will be tested, FOR YOUR BENEFIT do 
not read further until you have completed each task the way 
you think it should be done. (No on® is going to count the 
number of questions answered eorrectly-~£&e JfeSiM. ££& l9£ 
vour benefit .) If you answer incorrectly or perform a task 
incorrectly, re-read the questions and correct your original 
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- 2 — 

At the beginning of each class , your instructor will 
inform you of the maximum number of lessons which you will 
be permitted to complete that day* Upon completing a lesson, 
raise your hand and you will be given another lesson* When 
you have completed all the lessons permitted for that day, 
raise your hand and you will be given your “check-up ques- 
tions . “ Upon completing your “check-up questions," raise 
your hand and the instructor will pick up your questions. 

If you complete the check-up questions before the end of the 
class period, you may work on some reading assignment. 
Although everyone will be working at his own pace, it is 
suggested that you take your time. 

You are expected to nr aka arrangements with your 
instructor for any lesson you might miss because of absence. 

Here are some examples to show you how the format 
will look* 

Sots of elements are denoted by the two braces | 
and J * Given the two sets of integers 

{l, 2, 3, 4, 5} and [4, 6, 7?, 
circle rqfl that integer which is common to both sets. Do 
not read further until you have performed the task l 

kid you circle the 5? You didn't? You are correct, 
the 5 is not in both sets. However, the 4 is in both sets 
and you are correct if you circled the 4 in both sets. 
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- 3 - 

Given the following two sets 

•j^X, 2# 3j end \j^ 9 » 

list all the integers which are in either of the two 
sets: . Have you listed the integers? Do it 

now before they disappear-- -or before you read further* 1 

Did you list only the integers 1, 2 , and 3? If you 
did, re-read the question* You were asked to list the inte- 
gers in either of the two sets* The integer AWhich are ih 
either of the two sets are l, 2 , 3 , 4* and 5* 



Turn the page. You are ready to begin. 
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I* Do You Remember Sets? 

You probably remember many things about sets and the 
union and intersection of sets. 

Do you remember that a set consisting of the integers 
-2., 0,1*: 3,- and 4 can be shown like this? 

<-2, 0, 1, -3, 4 } 

You do? Great! How would you show a set containing inte- 
gers 6,7,0, and 9? Write it ..in this spaces 

Stop! Do not read any further until you have written the 
set in the blank. 

i 

Great! That’s the way we’ll be doing it throughout 
this material. Perform the task requested before reading 
further. Now, the way to write the set of integers men- 
tioned is 

is, 7, 8, 9 ] . 

Definition lj The union of two sets consists of all the 
distinct elements in either of the two sets. 

* , l 

Suppose we have the two following sets 
1,- 2, 3, 4 j and j 5, 6 j . 

The union of these two sets will therefore be the set 

C ' 2 

l 1, 2, 3, 4, 5, 6J . 




One way of showing this is 

£l. 3, 4 J U ji5 ( 6} = jl, 2, 3, 4, 5, 6^ . 

The symbol U denotes union. 

Alright, let's see what you would do with thiss 

\ 1, 4, 5, 5 J U ^8, 9} = ? 

Go ahead, complete the blank. 

The response was correct if you wrote 
^i, 4, 6, 8 , 9 J . That is, 

{ 1 . 4, 5 , . 6 j U js, 9 J = { 1 , 4, 5, 6, 8, 9 }. 

Got it? O.K., let's move on. 

What is the union of the next two sets? Write their 
union in the blanks 

£l, 2, 3, 4 j U $4, 5, 6^ = 

Don 1 1 read further until you fill in the blank! 

Did you write j 1, 2, 3, 4, 4, 5, 6^-? 

You did? Go back to Definition 1_. Notice that the union of 
two sets consists of all the distinct integers which are in 
either of the two sets. This means if you have an integer 
that is in both sets you include it in the union only once . 
Therefore, the correct response is Jl ff 2, 3, 4, 5, 6 ] , 
counting the integer 4 only once. It is important to note 
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that the order of the integers in the set is not important. 
That is, | 1, 2, 3, 4/ 5, ej is the same set as 
| 4,.. 3, 6, 1, 5, 2 } . ... .. 

Suppose you had the same two &efcs, ^ 1 , 2, 3, 4 J and 
4, 5, 6^ , and you were ashed to name the integer that is 
common to both sets. Tlie integer you would name is . 



Definition 7j The intersection of two sets is that set of 
elements which are common to both of the two original sets 
The symbol ( ^ denotes intersection. Hence 



[l, 3, 5, 9} f\ [5, 7, 8 } 



Do not read further until . you, have , completed the blanks. 

Right, if you said the integer 4; It is in the set 
^1, 2, 3, 4 \ and in the set { 4 , 5, 6 J . Did you write 
j 5 ^ for the intersection of ^ 1, 3, 5, 9 \ and ^5, 7, 8 

\ 5 ^ is the correct response. | 5 ^ is used rather than 

just 5 because the intersection of two sets is also a set . 

It is possible for a set to exist without any members. 
Such a set is called an empty set and is denoted by ^ ^ or 0. 

Another name that is given, to such a set is the null set. 

What is the intersection of the next two sets? 



j 1. 3, 5 1 r \ $6, 7 ( 



Did you write 0 or ^ ^ ? You're with itl There is not an 




integer in the two sets that is common to both sets. There- 
fore, the n set is empty. 



Just to make sure that you're clear on the idea of 



the ij and the 0 # let's consider the set I - J'l, 2 e 3, 4, 



Complete the following sets; 

1. A H C = 

2. B U D = 

3 . d n A = 

4. C n F = 

5. (c n f) n e * 

Problem No. 5 is particularly interesting. In No. 4 
you found the set C 0 F. No« 5 asks the questions What is 
the H of the set C f| F with E? Answers to the five problems 
are shown on page 7 . 

A Venn diagram is not unfamiliar to you. Let's look 
at two Venn diagrams representing 
no elements in common. A 




5, 6, 7, 8 ]• let 

E = { 2 , 4, 5, 6, 8] 

F = {2, 5, 7, 8} 



B = {l, 3, 6, 7^ 
C = \2 0 4, 6, 8} 




Note that A Pi B = ^ 1, 2, 3, 5, 7? D 

^1, 3, 7 | and that C 0 D - ^ 6 l • 




two sets A and B which have 

_ B 



r 



133 



The set A U B consists of all the elements in set A and 



set B. We can represent all the elements in each set by 



shading each set. 



Thus A B 




A 




e 



The intersection of two sets can also be shown with Venn 
diagrams. 



Consider two sets B and C which have some elements in 



common. This condition may be represented by .. 




with the shaded region representing the C\ . Again, the H of 




is the empty set. That is, A D B = £ ^ . This is true 
because sets A and B have no elements in common. 

Given three sets D, E, and P 




\ 




1 



6 



D D F can be shown as 




Again (E 0 F) Pi (DflF) is shown as the cross-hatched 





3. Having completed the above two tasks, shade 
(D n E) n (E n F) ins 




The correct shading of these three tasks is shown 




on page 7 . 
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Answers to Performance Tasks 



Page 4. 



1 . 

2 . 

3. 

4. 

5. 



( 2 } 

U, 3, 6, 7 } 

{ 3 } 

\ 2 . 8 } 

\ 2 , 8 \ 



Page 6 





- 8 - 



3 , (d r • e) r\ (e r\ f) 




! 
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II. The Line 

A line can be drawn through any two points. Thus if 
we have a line, any two points on the line can be used to 
refer to the line — that is, to name the line. 

Hence the line ^ 

m ■' -j P * 

A B 

can be named, line ,-AB* Since a line extends indefinitely in 
both directions, we place arrows on the line to indicate this 
property. Thus we can denote line AB by the symbol AB. 

• ' v • * 

A line contains many more than two points. Since we 
have noted that a line can be noted by any two points on the 
line, the line 

0 '■ ■ o 

A C B D 

can be named AB, AC, AD, or CD or any c ombination of two 

points on the line . 

* \ * • 

Let us partition a line into three parts by denoting 
a point A on the line. 




left half-line right half-line 



D efinition 3.: The portion of the line to the right of h is 

named the right half - line and the portion to the left is 
named the left half - line . The end-point A of both half-lines 
is i ncluded as part of either half-line. 

|| er|c 



Thus, the entire line can be expressed as 

left half-line U pt. A U right half-line 
If we we re to denote points B and C on two opposite half- 
lines (having A as their end-point) as 

__A ^ 

we can express the entire line as 

half-line AB U A U half-line AC. 

Notice that the half-line is denoted by placing the end-point 
A firs t in its order. of letters. Also, notice that point A 
is denoted by writing A. 

Perhaps it would be helpful to show the half- line AC 
as follows 



The open circ le at A denotes that point A is. not included. 
The so3.id point at C denotes that C ijs included. Thus half- 
line AB may be shown as . 



Definition 4; The set of points consisting of a half -line 
and its end-point is called a ray . The end-point of the 
half-line is the end-point of the ray. 

As there is one and only one line containing any two 

■ * 

points A and B, 
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- 3 - 

there is one and only one ray with end-point A and containing 

-V 

the point B. We call this the ray AB and write it as AB. 
There is also the ray BA with end-point B and containing A. 

We have 

AB . A 



AB 



BA 

AB 






o 



B 



B 



■ < ■■■■ ■* 



B 






.A 



B 



’v , 



_A 



B 



Line AB 
Half-line AB 
Half-line BA 
Ray AB 
Ray BA 

Line segment AB 



Definition 5.: The line segment AB, written as AB, consists 

of the points which AB .and BA have in common. That is, the 

T , "" 

set of points AB is the . of the set of points AB 

and the set of points BA*. Did you write the word intersection 
in the blank? Remember, the ^ of two sets on a line is the 
set of points on the line which are common to the two sets. 



what* 


s going 


on: 


AB 


1 




\ 


AB 








* 


* 


BA 


< . X 


;b 



The points A and B and all of the line in between A 

-JV **— *> .... 

and B are found in both rays AB and BA. Therefore, their / 
consist of points A and B and all of the line between points 
A and B. This is exactly AB, by Definition 5. 



o 
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4 



I 



In order to make it easier to picture, let's show the 
set of points AB above line AB and the set of points BA helow 
the line AB. The intersection of AB and BA on the line AB is 



AB shown in red* 



A 



B 






L 

7A 






B 



B 



Suppose we had a line with four points represented 



on it. 



<r ♦ - 

> 



A ,J3 £ ^ 



The f'\ of CA and BD are determined by representing one set 



of points above AD and the other set of points below AD as: 



1 " ■ 0 ^ 



A 



«■ 



A 



B 






D 



k B 



D 



-> 



The r\ of CA and BD is shown in red. That is, 

• •H* ♦.*—*»* 

CA I \ BD “ . 

Did you respond by writing the answer in the blank? Don't go 
further until you take the time to write in the answer. You 

will have more like this one. 

What did you write? BC consists of the set of points 
which are common to both CA and BD and therefore BC is the 
correct answer . 



II ERJC 



I. 
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Suppose we consider the set of points consisting of 
(BA U CD) as one set (shown in blue) and the set of points 
BC as a second set (shown in green) . Their could be 
found in a manner similar to the preceding examples: 




Notice that the points between B and C on BC are not found in 
the set BA U CD, However, the ' points B and C are common to 
the set BA U CD and to the set BC. 

That is, ' •• • 



— ■bp* 

(BA U CD) D BC « 



Be sure ana fill in the blank by looking at the set of points 



shown in red. What did you answer? The correct response is 
B U C. 



You will now have a chanctj to name the <T\ of some sets 
by observing their intersection on a line. In all cases the 

- • . v ; i 

points shown above the line represent one set of points on 
cind the points shown below the line represent a 
second set of points on the line. 



1 , 






-O'" 



***- » B . D .i 



B 



D 






half-line CA H BD = 







6 - 



.A- 



i 



A IB ;C .D 

> r , r , A rr.. « u . — ■ 4 -~- 



t 



B _C ■ 



AB r\ BC = 



<—♦ 



A 



_^A — 



1 V 

▼ v r» 






t 



•<W»> 

AD .O BC 






-E-> 



4. 



A_B .C 



<-* 



x 1a ^b i 



:c ,d 






A A A 

A - 



(AB U C) A DA 



— ■> 



5. 



O 



A 



it 



^ ;b .^c 



D 



t 



>B— »c 






half-line AC H BC 



Have you completed the above performance tasks? No? 
Take the time to fill in the blanks. The practice n o w will 
help you later . 

You have finished the tasks? Check your answers with 
these: (1) half-line CA; (2) B; (3) BC; (4) AB U C? 



(5) BC . 



3 
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III. The Line Re-visited 

In Part II you were shown what the intersection of 
two sets of points on a line was. It always consisted of 
another set of points. , What do you do to determine the inter 
section set?, . . 

TAJhen we are speaking of the intersection of two sets 
we are speaking of those points which are to both 

sets. When we were working with Venn diagrams, we 

#• ; ♦ 

the regions which were common to both sets. Stop! Stop! 
Don't read on! — That is, until you write in the missing 
words in the blanks. 

Now! rid you write in the words common and shaded, 
respectively, in the above blanks? , You did? Then you may 
skip to the next paragraph right now. If you did not, per- 
haps you have forgotten that the intersection of these two 
sets 

[1, ?, 3,’ 4 f and j> 4, 5 ! 

is the set ( 4 | since 4 is common to both sets. Also, the 
intersection of sets A and B is shown 

by the shaded region. 








2 



We can find the intersection of two sets of points on 
a line and indicate the intersection set in a way very simi- 
lar to that which we've already been using. To show what 1 
mean by this, let's consider a number line on which the 
integers are associated with particular points of the line: 

• * * « ■» — » » ~ > ■ 

- 3 - 2-10 1 2 3 4 



Definition <5: The numbers . • . -3, - 2 , -1, 0, 1# 2 , 3, 

. . . are called the coordinates of the points associated 



with them on the line. 

The number line does not have’ to be drawn in a hori 
zontal position. Let us call the nuftiber line pictured 
below AD. A 



3 ■> 
2 “ 

1 “ 
0 - 1 
-1 ■■ 
-2 - 
-3 
-4 



A 



B 

C 

D 



The coordinate of point A is +3, of point B, 0, of point t, 

-2, of point D, . The blank is for you to fill in! 

Remember that we indicate that the line extends indefinitely 



0 



3 
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in each of two directions by placing an arrow at each end of 
our figure. 

How do you describe' sets of points ori-a line? We 
describe sets of points on a line by constructing a graph of 
the points on a line. 

Definition 7_s The set of points associated with a set of 
numbers is called the graph of the set. 

Let's construct the graph for the set A, where 

A = ■> 1 , 2, 3„ 4, 5 ! . 

L • J 

We place solid dots on a number line at each of the points 
which correspond to a number of the set A, as follows s • 

' * -> 

1 2 3 4 5 

Suppose another set consisted of all the real numbers 
on a line, rather than just integers. Since the number line 
represents all real numbers-, the graph of the set of real 

numbers would be the entire line. Thus, the graph would 

■ • » 

show a heavily shaded line rather than a series of dots. 



• o 

We shade part of the line to graph the set of all num- 
bers 1 through 4. The heavy dots indicate that 1 arid 4 are 
members of the set. 

— * t 1 f — 1 i ! ’ « ! h 

-1 0 1 2 3 4 5 6 



Notice that what we have shown is a line segment, . Using a 
red pencil, why don't you construct the graph of all the 
numbers 2 through 5 on the line below s 

1 «» — j — | j 1 f t f 

-1 0123456 

Great, you'll move faster if you take time to perform each 
task. Did you shade the part of the line from 2 through 5 
with heavy dots at 2 and at 5? Check. your graph with the 

one on the answer sheet, page 15. 

We use hollow dots when points are not included. For 

• t 

example, we graph the set of all numbers between 1 and 5 as 
in the following figures 

— i 4- O "T‘ L) * >- 

-1 0123456 

It's your turn again. Using a red pencil, construct the 

graph of all the numbers between 0 and 4 on the line below s 

+ t f— t + f t — — + — > 

-1 0 1 2 3 4 5 6 

Did you use a red pencil? It will help. Your graph would 
look like 

<--+ Q , i l i nr-e 1 * > 

-1 0 1 2 3 4 5 6 

except yours will show the shaded portion and the open dots 

in red. Since you were asked to construct the graph of all 



5 
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numbers between 0 and 4, the points at 0 and at 4 are not 

* # 

included. Thus, be sure that you show open dots at 0 and 
at 4. 

What would our graph look like if we wanted to show 
the set of points which include 0 and all the numbers between 
0 and 4? You're right! We would show a heavy dot at 0 and 
an open dot at 4 with the line shaded in between 0 and 4. 

That is, it would look as follows; 

_ " < £ 1 j ♦ 1 """ I 1 1 — h > '-* $ 4 — ^ — I 1 "" '-— " i— ■ > - 

• • V -1 0 1 2 3 4 5 6 

: ■ * 1 

Next let 's construct' the graph of all numbers ’ g reater - than 
or equal to 1. We place a heavy dot at 1 and draw an arrow 
to show that - all the numbers greater than 1 are numbers of 
the set, as follows; 

* 

■* < " ■ ! '■ ( ' 1 " 4 " " 1 1 i 1 1 1 1 i ' ■ — »— 

-1 0 1 2.3 4 5 6 

You will recognize this graph as a ray . 

Now, the graph of the set of all numbers greater than 1 would 
be as follows; 

— H 1 Qb 1 -I h "| | ^ 

-1 0 1 2.3 4 5 6 

Here we placed a hollow dot at 1 to show that it is not to be 
included in the graph and we drew an arrow to the right to 
show that all numbers greater than 1 are members of the set. 
This, of course, is a half-line . 



6 
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Sometimes the symbolism [a, b] is used to represent a 



set of points, \on; a- line in the, interval from a to b> with 



fepfh end-po i nt s a^ end b included in the set. For an inter' 



val of real numbers, [2, 6] ' represents all of the real 



numbers from 2 through 6 inclusive. The graph of the 



interval [2, on the number line is 



-i — ^ 



-10 1 2 : •; 3 4 



We use- the symbolism to represent the points 



on the interval from a to b, exclusive of these two end- 



II '- « I 



points. The graph of the interval (2, 6) on the number 



line is 






i 1- 



■e- 



-1 o 



4 5 6 



A combination of these symbols may be used to indicate 

'• ' ) 



that one end-point is included but not the other. Thus 



[a, b) is used to represent the end-points in the interval 



from a to b # including a but not including b. The graph of 



[1, 5) is 






-10 1 



2 



4 



while the graph of (1, 5] is 



-Or 



■ H 



-ri 



-1 0 



5 6 



i: 






nfnririM M mTrr , i ' 
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O.K., ready to try some? On the line beside each stated 
interval, construct its graph 

2 . [ 1 , 3 ] 



3. (-1, 4) 



4. 



(“ 1 , 2 ] 



5. [0, 6) 



1 — 
-1 

f 


j 

0 

— — -j.. .. 


— 

1 


~H — 

2 


— 1 — 

3 

l 


— I — 

4 

i 


■ — 1 

5 


— f— 

6 








1 


l ■ -■ 








— + 




-1 


0 .. 


1 


2 


3 


4 

• 4 


5 


6 




f — - 


— i — 






t _ 


/ 






«v 




f 


r 










■— 1 / ■ 


— V 


-1 


0 


1 


2 


3 


4 ' 


5 


6 
























1 


» 






— H 




t— 


— > 


-1 


0 


1 


2 


3 


4 


5 


6 





The graphs of each interval are shown on page 15 
The union of two intervals, say 



[-1/ 2] U [3, 6] 

may be shown as 

<r-i — — * 1 1 * 4 r 4- — * 

-3 -2 -1 0 1 2 3 4 5 6 7 

The construction of the union [-1, 3] and [1, 5] is a 

little more difficult to show on paper. Wait a minute. 
Let’s use the procedure for constructing the U or f) of rays 
and line segments that we used earlier. Let's show one set 





mmm 



